500 and 508 pages?
-
Hi we just did a massive deepcrawl (using the tool deepcrawl.co.uk/) on the site: http://tinyurl.com/nu6ww4z
http://i.imgur.com/vGmCdHK.jpg
Which reported a lot of URLs as either 508 and 500 errors.
For the URLs as reported as either 508 or 500 after the deep crawl crawl finished we put them directly into screaming frog and they all came back with status code 200.
Could it be because Deep Crawl hammered the site and the server couldn't handle the load or something?
Cheers, Chris
-
Could it be because Deep Crawl hammered the site and the server couldn't handle the load or something?
Correct.
The server reached its max resource limit. Try to set a longer delay on requests, if this is a setting in deepcrawl.co.uk?