Questions
-
803 Error
Hi there! Tawny from Moz's Customer Support team here. I think it's pretty unlikely that we'll change the behavior of our crawler, unfortunately. When we crawl your site we adhere to the “Politeness Policy” so that we don't impact the performance of your site: We do this by dynamically controlling (throttling) the number of URLs that we crawl per minute, per hour. If we determine that your site is responding slowly or there are network issues, we extend the crawl intervals. Following the Politeness Policy protects your site from excessive load. Roger Mozbot schedules and crawls thousands of sites a day. Other items can affect the crawl, including changes to your site, network conditions, how your site crawl is scheduled compared to other crawls, etc. Hope this helps!
Getting Started | | tawnycase0