MOZ Crawler only crawling one page per campaign

[AllaO]

We set up some new campaigns, and now for the last two weekly crawls, the crawler is only accessing one page per campaign. Any ideas why this is happening? PS - two weeks back we did "upgrade" the account. Could this have been an issue?

[AlanMosley]

can we see urls, there may be a techniocal reason

[kchandler]

This happened to me in the past. My client's site had a custom 404 that redirect all missing pages to the homepage. When roger bot (seomoz crawler) searched for the robots.txt page (that was non-existent) it continually got redirect to the homepage.

So on that note, check if you have a robots.txt file. If not, add one and see if it solves the problem.

[KeriMorgret]

Also check out this help desk article on reasons why the crawler gets stuck at one page on a campaign. http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page

[AllaO]

Thanks for the suggestions. There was not a robots.txt file. I'm hoping that will do it.