9,194 Crawl Errors on my website!!!!

[Gwilso]

This post is deleted!

[Gwilso]

Can no one offer any advice on this one?

[MikeTek]

Hi Gwilso,

I don't see anything wrong in your rewrite rules.

I see a lot of false positives on 4XX errors on my campaigns. Sometimes the MozBot crawler comes up with some interesting URLs.

You have any indication this is a recurring problem? I'd check the log files to determine that.

I'd also correlate what you're seeing in SEOmoz Crawl Diagnostics with your Google Webmaster Tools crawl reports - see if Google is hitting this same URL.

Bottom line is this is most likely not worth fretting over unless you see a lot of log activity around this URL request. Crawlers do weird things sometimes. Doesn't necessarily mean your site is "broken" or that this is impeding your SEO or user experience in any way.

-Mike

[Gwilso]

Thanks Mike,

Our latest crawl report doesn't show any of these errors; although i'm not quite sure where they've gone!

[MikeTek]

Hi Graeme,

No worries.

Chances are these errors were not true errors being encountered by users or search crawlers, but were exclusive to the SEOmoz Linkscape crawler, since it often hits URLs based on the existing index (which can be up to a month old at this point).

Always a good idea to correlate with GWT and your server logs to figure what Googlebot and other users are actually hitting.

Best,
Mike