Moz Crawler fails on the first page

[philipdanielhayton]

Hi guys,

Can anybody shed some light, I'm running a crawl on a client's website but it's failing on the homepage and not crawling any other pages. It appears to be throwing an 804: HTTPS (SSL) error and then terminating the crawl.

Now, the page in question was serving up mixed content up until about 4 days ago, but has since been fixed. I read that we should wait at least 48 hours before initiating another crawl to avoid hitting a cached version - which I did, but it still appears to be having issues.

Is there anything specific I can do to get around this issue? I'm on a trial account and this feature is one I'm keen to test, so there is a bit of a time constraint.

Any help is greatly appreciated!

Thanks in advance!

[tawnycase]

Hi there!
Thanks for reaching out, and sorry for the trouble! I'm afraid there's not much you can do to your site to prevent this issue - it has to do with our crawler.

Unfortunately at this time our crawler isn't compatible with Server Name Indication (SNI), which appears to be in use on your site. In general, SNI is a totally acceptable security configuration, but our crawler simply isn't equipped to be able to handle these settings.

The good news is that our team has been working hard on a new crawler that will support this configuration and this crawler is currently in its Beta phase. If you're interested in being a part of the beta testing, the link to the sign up page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1. Once you fill out that form, you will automatically be added into the Beta during the next round.

We will be rolling the new crawler out to all of our users once it's out of it's Beta phase, but I don't have an exact timeframe of when that will be at this time, as it's still being actively worked on.

In the meantime, I apologize for the inconvenience. If you have more questions or if there's anything else we can do to help, feel free to shoot us a note at help@moz.com and we'll do our best to sort things out for you.