How to use Crawl Report for a test directory

[SWDDM]

I have a client's new site set up in a folder that is not linked to from the main site. When setting up the Crawl Report, I put in the starting url for the new folder, http://oldsite.com/new/start.php. The Crawl Report came back with a crawl of the current site instead. How do folks run the crawl report to test sites before they are public? Thanks!

[Peterli]

Mary,

Thanks for reaching out to us!  That is a good question!  Our crawler can only crawl sites that are indexable and that are public, so if you set the report to run against the starting URL for the new folder, it would try to find that folder if it is public.  One thing you could try out is to set your site public right before a crawl date, then immediately close access to it, this is the only way I can think Roger would be able to do it

I am sorry that I can't offer something better, I hope that helps!

Best,
Peter
Moz Help Team.