Duplicate Content Issue

[WaterSkis.com]

SEOMOZ is giving me a number of duplicate content warnings related to pages that have an email a friend and/or email when back in stock versions of a page.

I thought I had those blocked via my robots.txt file which contains the following...

Disallow: /EmailaFriend.asp

Disallow: /Email_Me_When_Back_In_Stock.asp

I had thought that the robot.txt file would solve this issue.  Anyone have any ideas?

[donford]

Hi Anver not all crawlers act the same, but in theory your blocks should work you can test it at phpWeby.com with different user agents..

Just an FYI I just hit

...kis.com/EmailaFriend.asp?ProductCode=HO_Wakeskis

And was told it was able to be crawled by line 1 of robots.txt

Looking at your robots.txt file I see user-agent:* listed twice.

Also another solution in addition to blocking with robots.txt would be to include the rel="canonical" tag to the root page therefor pointing all dynamic urls back to EmailaFriend.asp

Hope that helps,

Don