How does SEOmoz pull its duplicate page title and content information?

[jwanner]

I ask because I am getting errors based on URLs that do not even exist on our site.  For example:  http://www.robots.com/applications/abb/panasonic/robots this URL does not even exist for our site, but somehow it is listed in the error section of page title duplication tool.  http://www.robots.com/applications/ exists, but there is no place to get to an ABB or a Panasonic robot from this page, not to mention an ABB/Panasonic (which for sure does not exist).  ??

We have quite a few of these out there and just wondering how to find out where the link is coming from.  When we checked our URLs through Integrity, links like the one listed above (which we had 29 of them listed) that do not show up.

Thoughts?  Thanks!

Janelle

[GManSEO]

Hi Janelle,

When I copy and paste the URL you supplied above http://www.robots.com/applications/abb/panasonic/robots

I get a page to come up.  So this page does exist somewhere.  Even if you can't navigate to it from the standard nav bar on your site it may be linked in your sitemap or in other dynamically generated places.

Looks like you need to map out your URLs and find the places where weird ones are still getting indexed and clean them up.