When does SEO.Moz run its crawl?

[gavinr]

Hi All

Is there a way to discover when SEO.Moz runs its crawl?

I have two sites on our dashboard and both our returning Crawl Error 904 error for the last 2 reports.

I am struggling to discover why the 904 crawl errors are happening and my IT department is asking for a time that the crawl is being run. Any way of finding out?

Thanks
Gavin

[Chris.Menke]

Gavin,

As per Moz'z Crawl Dagnostics page under the Frequently Asked Questions heading, Moz crawls your site once per week on the same day of the week as you first set up your campaign and they try to keep it to the same time of day for each crawl.  Check your server logs to see when Roger Mozbot last crawled your site to determine it's next crawl.

[seovp]

You'll also receive an email each week when the crawl is completed so you can just simply check when you last received the email and expect the crawl to run at a similar time each week.

Regards

[gavinr]

Thanks all for the responses.
I receive my email from SEO.Moz on Sat but the first crawl was on a Thu.

Does anyone know how long the crawl takes?

Cheers
Gavin

[DavidLee]

Hi Gavin!

We begin crawling/collecting data for sites based on the day your campaigns were created. You have a campaign created on a Wednesday and the other on a Friday. Depending on how many pages we crawl, it takes generally under or over 24 hours to complete if they are between 0-20,000 pages. Crawl data will appear by the end of the following day (PST). So your Wednesday campaign data appears on Thursdays, and the Friday campaign appears on Saturdays.

Specifically for yours:

Data (crawls, rankings, traffic visits) updates on Saturdays for "LT" and Thursdays for "ST".

If you create a campaign on a Tuesday, data will appear every Wednesday, etc. All server times are PST since we are on the West Coast so those in Europe may not see data appear until Thursday morning.

[gavinr]

Hi David

Thanks for your response. We have now identified the times the crawls are run and are still receiving the 904 server response even though we aren't getting any Pingdom alerts during that period and my IT team report no server issues either. The 904 errors are a bit of a mystery in the Moz reports unfortunately.

Thanks
Gavin

[DavidLee]

Anytime Gavin!

In most cases we have seen those type of errors relate to packet loss between carriers. If they are ongoing I would have your hosting provider request their ISP to investigate any possible routing issues to your site. Depending how great the issues are, some ISPs are pretty good at catching them and replace bad network cards while others may not.

Hope this helps

[stevefidelity]

I had never even heard of 904 errors before encountering them with Moz. The first time I ever saw it come up it coincided with a bandwidth usage issue that the client was having as well as the most significant/sudden drop off in organic rankings I've ever seen personally. Despite the fact that the client did make changes to his hosting plan to alleviate any bandwidth issues, the 904 errors continue to persist and the organic rankings continue to be less than stellar.

Can 9xx errors like have a significant negative impact on organic rankings?