How to find an internal link that is generating a duplicate

[catherine-279388]

Hello Mozers

Can anybody help me.  It's a bit OCD, but, I really want to find the internal links within a clients site that are generating duplicate urls.

I did start looking page by page using search, but got a bit stir crazy!

I'm sure one of you smart SEO's will have a simple, clever solution:)

Thanks

Catherine

[Alex-Harford]

It's not OCD, it's good practice!

If the duplicate has been indexed, you could try using the link: operator with the URL in Google search.

Do you have Xenu Link Sleuth? If not it's free, and don't worry if it looks dodgy, it is kosher. You could crawl the whole site with Xenu. Once the crawl is complete right-click on the URLs you have as duplicate content and it'll show the pages that link to it.

[catherine-279388]

Thanks Alex

Two very sensible suggestions, thanks.  I just got myself in a loop!

Ta

[Brian-H]

Run a manual crawl using seomoz crawl tool and look at the referring url. The check the page source of that page for the duplicate url.

[catherine-279388]

I've just submitted one.

Thank you Brian

Catherine

[Brian-H]

No problem. I don't know why you are not able to see the referring url from the campaign crawl errors...it would be nice to not have to run the manual one but at the moment that seems to be the easiest solution.

I'm working on a site at the moment that has me going around the bend with duplicate pages!

[catherine-279388]

My problem is that I do have the referrer, it's an internal page, often the page that is creating the duplicate content.  I keep searching for links that are generating the discrepancies and can't find them.

I've run a report using xenu, but now I've got even more wood (can't see the wood for the trees).

Can you recommend any good resources for using xenu?

That would be a big help!

Thanks Catherine