Questions
-
SEOMoz site crawlers created an issue for our servers
Hi Stephen, If your server can't handle the SEOMoz spider, it wouldn't probably survive to all the malicious spiders out there... You should realy think into getting a new hosting account/server (or a new IT dept...). In the "Campaign Settings" you have a "Weekly crawl completed _for campaign: _" checkbox that you could uncheck to disable the crawling of a certain campaign. You might also want to use the "Crawl-delay:" directive into your robots.txt file, I don't know if it is supported by SEOMoz spider, but it might protect your server from other spiders. Otherwise, like Barry Smith suggested, you should get in touch with SEOMoz team and see what they can do. If their crawler doesn't support the "Crawl-delay:" directive, you might want to suggest them to implement it. Best regards, Guillaume Voyer.
Moz Tools | | G-Force0