Duplicate content and the Moz bot

[JamieHibbert]

Hi

Does our little friend at SEOmoz follow the same rules as the search engine bots when he crawls my site?

He has sent thousands of errors back to me with duplicate content issues, but I thought I had removed these with nofollow etc.

Can you advise please.

[Mark_Jay_Apsey_Jr.]

Make sure you have no followed the correct pages....

[Nick_Sayers]

Hey There,

Rogerbot will still follow Nofollows because it needs to get a holistic view of the site.

Here are some things you can do about duplicate pages:

Delete content that is similar on each page.

Add some new and unique content to each page that is on the report. This can be done by adding more information, ideas, product descriptions, or anything that can make it differ from other pages on the domain.

You can also add a rel=canonical to one of the duplicate pages. Here are a few ways to do this:

Add a rel="canonical" link in between the  and elements. This should be done on the version of the page you want to be ranking or that non-canonical version of the two (or multiple) pages.

To specify a canonical link to the page http://www.seomoz.org/blog.php?item=seomoz-iscool, create a  element that looks like this: <link rel="canonical"href="<a href="http://www.seomoz.com/blog.php?item=seomoz-iscool">http://www.seomoz.com/blog.php?item=seomoz-iscool"/></link rel="canonical"href="<a>

Copy this link into the  section of all non-canonical versions of the page, such as http://www.seomoz.com/blog.php?item=seomoz-iscool&sort=fun.

This should successfully eliminate the duplicate content issues.