Crawl error

[Happy-SEO]

Hello,

We've launched a website a week ago. When run the website through Screaming Frog SEO Spider i get an error and no further pages are recognized.

http://compleetverkleed.nl/
text/html; charset=iso-8859-1
301
Moved Permanently

https://compleetverkleed.nl/
0
Connection Refused

(We've switched from http to https)

Does anyone know how to fix this problem?

Thanks!

[DirkC]

Hi

I just tried the same thing with Screaming Frog and the crawl started without problems. Maybe related to a temporary issue with your server?

It seems your site is extremely slow - especially 'time to first byte' - check http://www.webpagetest.org/result/150416_D1_FZF/1/details/. Is your server properly set-up & dimensioned? If I do a check with pingdom - it seems your server config has some issues: http://dnscheck.pingdom.com/?domain=www.compleetverkleed.nl%2F - you might want to look at that (SOA record is missing which could be caused by  a bad configuration of the nameserver / there is also a problem with DNSSEC) - I am not that technical, so can't help you much with this config issues - but I would check with your hosting company or some technical expert to see what's wrong.

I also noticed that your site loads a lot of javascript (61% of the content downloaded is javascript) - which is huge.

Hope this helps,

Dirk

[1akal]

Hi,

I have checked your URL:

http://compleetverkleed.nl/  in Screaming Frog and got 488 Pages recognized by tool. (with http and https both)

Didn't get any error message.

[Happy-SEO]

Thanks for the support!