Re : Duplicate Content

[dasjoy85]

Hello,

I am a pro member, in my campaign it says duplicate content for few urls. which i m not able to understand, because both the url's are same but why its showing under duplicate content. here are the urls example.

http://www.giftbig.com/helios-gift-card.html

http://www.giftbig.com/helios-gift-card.html/

[TomRayner]

I wouldn't worry about this error in the campaign.

It may be that the moz crawler has tried to index the second URL - with the slash - because a site might be linking to it, or it could be in your sitemap, worth checking if this is the case.

But I can see that you have a canonical tag set up on your website that will prevent Google from indexing the second URL and potentially seeing duplicate content.  Indeed, after having searched for the second URL in Google it does not appear to be indexed, so there should be no duplicate content issue.

Check no one is linking to your site in that way, or if it's in your sitemap.  If not, chalk it up to a Moz crawler error and don't worry about it!

[JustinTaylor88]

Agree with Toms comments

If you want to tidy up this error, go through the site and make the links consistent (ie change http://domain.com/page to http://domain.com/page/ throughout and that should solve the problem.

This is particularly worth while if you share the reports with your customers as customers hate seeing errors.

Hope that helps

[GregoryTK]

I am also seeing sudden spikes in Duplicate Content for several campaigns and I keep seeing questions about this in the Q&A.  This leads me to assume that there is an issue is at SEOmoz' side...

There is no reason that I would suddenly see an increase without having made any changes.

Just checked the data manually and in my case the Duplicate warnings are valid actually...

[JustinTaylor88]

Thats interesting, i've not noticed anything on any of my campaigns

Out of curiosity, does the list of duplicate URL's  give any clues as the what may be causing the duplicate pages error? Could Moz have updated their crawler to be case sensitive or something along those lines ?

[GregoryTK]

Hi Justin,

Ow... I just had a quick look and if I am not mistaken SEOmoz might actually have gotten better at picking up the duplicates in my case.  I just manually went through the list and I can't really fault the results... in hindsight.

Note to self: manually check the data next time before replying to any posts!

Cheers

Greg