Is there a Modern GSiteCrawler

[GarySargent]

We have a site with 1000+ URLs.  We'd like to index all of the pages capturing URL's, Page Titles, etc with 100% accuracy.  Which SEOmoz tool would be best at this?  PS - in the old days we used the likes of GSiteCrawler.  Thanks for your direction.

[CoreyNorthcutt]

Sadly SEOmoz (or any SEO tool) never seems to solve more than 5% of the puzzle.  But I think Screaming Frog will probably do what you're asking (plus, it's free).  If not that, I like SEO PowerSuite's Website Auditor a lot, and always seems to pull back denser data than most alternatives (but isn't free).

[GarySargent]

Thanks Corey.  We'll investigate all of the helpful recommendations you made.

Also just confirming, in your experience doesn't SEOMoz's "SEO Web Crawler" do what we are looking for?

[CoreyNorthcutt]

Yes, actually the 'Crawl Diagnostics' tool that comes with SEOmoz Pro does let you export to CSV.  There are just two limitations:

• It isn't in real-time (and I've typically leaned towards instant gratification ).

• It may not find every page (to give you a real life example, one of my many experimental sites has approximately 1,000,000 pages .... in checking the Crawl Diagnostics export just now, SEOmoz found 10,319).  But for smaller sites that our agency works with, it's pretty much spot-on.