Tired of finding solution for duplicate contents.

[NitinRGoyal]

But the pages were there before add-on was added. Right ?

If they were then the Google may have crawled them and SEOMoz may have picked them from Google or some other engines which resulted in the issue.

So I suggest to wait and watch as you will get Crawl Errors every week from SEOMoz.

[chandubaba]

I also checked through Xenu and Screaming Frog Spider and both are showing the same thing. Check the attachment

http://i.imgur.com/HA09eNc.png

HA09eNc.png

[NitinRGoyal]

SEO spider is showing meta descriptions and is not saying that content is duplicate. It means it is not checking rel canonical on these pages as well. So it is not an issue.

Note that duplicate title / desc does not mean content is duplicate.

Tools which are looking at one thing only will give this issue. Tools which are specific for finding duplicate content will not give an issue.

[Dr-Pete]

As best I can tell, your canonical tags are properly implemented and Google doesn't seem to be indexing any URLs with "items_per_page" in them. Our crawler and desktop crawlers may be getting confused because there are internal paths to these variations.

Ideally, that pulldown probably shouldn't be crawlable, but I think your canonical implementation as it stands is ok. I don't see any evidence that Google is having problems with it. It may just be a false alarm on our part.

[chandubaba]

Then how can I rip off from seomoz crawler those links ?

[Dr-Pete]

We don't currently have a way to ignore warnings/errors, although I know that's on the wish list. Let me ping the Product Team on this one and see if they have any additional insight.

[Dr-Pete]

I talked to the technical team. The screen may be a bit confusing. Your "items_per_page" variations are not being flagged as a duplicate of "/hard-disk/portable-hard-disk/". All of the pages (including the items_per_page variants) are being flagged as near-duplicates (95%+) of "/hard-disk". Basically, since those pages show the exact same products and only differ by a header, we're flagging them as being too similar. Once we do that, then all of the other pages that canonical to the "/portable-hard-disk" page also look like near-duplicates of "/hard-disk".

It's not catastrophic, but if you have enough of these category/sub-category search pages that overlap on their results, you may want to reconsider whether you index all of them. At small scale, it's not a big deal. At large scale, these very similar pages could dilute your ranking ability.

[chandubaba]

So right now what should i do to solve this problem ?

[Dr-Pete]

You could canonical the "/portable-hard-disk" pages back up to "/hard-disk", but honestly, unless this is a widespread problem, I'd probably ignore it. if you have a lot of these sub-categories with duplicate search results, then I'd consider changing up your canonical scheme or NOINDEX'ing some sub-categories - search results just aren't high-value to Google, especially if they start all looking the same.

If this is an isolated occurrence, though, it's a lot of trouble for a relatively minor problem. It would take a pretty deep knowledge of your product inventory and site structure to know for sure, but my gut reaction is that this is a small issue.

[chandubaba]

Thank you. I will tell to my developer regarding this issue and than see what they reply.