Best tools for identifying internal duplicate content

[McTaggart]

Hello again Mozzers! Other than the Moz tool, are there any other tools out there for identifying internal duplicate content? Thanks, Luke

[anthonydnelson]

Duplicate content is going to be on your website. The key is to keep it out of Google's index. That is why using Google tools is very important. I find that using Google Webmaster Tools (duplicate page titles) and most importantly Google search as the best way to identify these problems.

This article is absolutely fantastic and there is a section titled "Tools for Finding & Diagnosing Duplicate Content" that explains exactly how to use Google and Google Webmaster Tools to find your duplicate content.

[Antony_Towle]

I use the Moz crawler to crawl my entire site and export it to an excel spreadsheet to navigate, its one of the first columns on your report

http://pro.moz.com/tools/crawl-test

Although i agree with Anthony and think its a very good idea to track any duplicate mentions from Google's perspective in webmaster tools

[Masoko-T]

Luke

Apart from the tools mentioned above, I use copyscape premium to identify duplicate text (in the body of the page), I also find these tools very useful:

Xenu Linksleuth: very good for finding duplicate tags in your page's headers (title, description), and for many other tasks that require crawling your site. And the tool is free!

Screaming Frog: Another web crawler and very good tool for finding duplicate tags. It is a paid tool (about 77 GBP per year) but has a couple of features that Xenu does not have.

Cheers

Jorge

[McTaggart]

Huge thanks for the advice and that brilliant article Anthony :-)!

[McTaggart]

Thanks James - good advice!

[McTaggart]

Thanks Jorge - Not sure how I'd survive without Screaming Frog - haven't gotten around to Xenu Linksleuth yet, but must give it a go sometime soon! Although I use copyscape to check for external duplication, hadn't realised I could use it to check for duplicate text within a website, so I'm v grateful for that pointer Luke

[rmilani]

Great article link! Thank you!

[Churchill1]

You should also use Copyscape and Siteliner