Can SEO Moz perform a full site crawl and provide a report showing all URLs within an existing domain?

[DCondon]

We are conducting a site redesign and need to get an idea of all pages that are out there on our domain (in some report fashion). This would help for discovery and cleanup as we re-work the site and move to a new CMS.

Thanks

[RyanKent]

How many pages are on your site?

The SEOmoz crawler will do exactly what you want but there is a URL limit. You should also understand it will experience the same limitations of any crawler. It wont list pages which behind a user log-in nor pages which are blocked by robots.txt. I am pretty sure the SEOmoz crawler doesn't list secure pages either but last I heard they were working on including them.

If your site has any island pages they wont be discovered either.

[DCondon]

Hey Ryan,

Thanks for the response.

It's not a huge site. I would say there's probably around 600 total pages. It definitely looks like the SEO crawler has crawled the entire site, but I can't seem to find a way to just get a one-shot view of all the pages it's accessed.

Any ideas on where this can be found?

Thanks again!

[RyanKent]

Are you looking at your crawl report? It is available in an Excel file which provides the exact information you desire.

[DCondon]

Yes - that's exactly it. Can I just do an export of the campaign crawl? or is that found somewhere else? Forgive my ignorance...still new to the tool and just can't seem to find.

[firstconversion]

just going to throw in an alternative for this type of thing Xenu Link sleuth - free, easy and powerful.

Yes that site looks like ass but the tool is great. Dr Pete and others have done "how to use" posts on seomoz - just search xenu on seomoz

[DCondon]

Hey Stephen,

THanks - I have heard of Xenu many times before. I'll try that out.

I appreciate the input!