804 HTTPS (SSL) error
-
Is there any updates on the issues with Cloudflare?
We like Moz but really would like this resolved.
-
Hi Moz Users,
Shouldn't it be fixed by now? We got the same problem at https://www.crowdsite.com
We also use SNI on our servers, is there a ATE to fix?
-
The fix we are working on involves a complete re-write of our crawler which will take time to complete. I'm afraid I do not have an ETA but will keep this thread posted with any updates.
-
Guys,
I don't work for Moz and I I know it sucks that they don't support SNI, even if every major browser since IE6 does it, but it isn't a hard fix to add a dedicated IP address for SSL.
If you use AWS you can get CloudFront's dedicated IP for $600/month or you can add CloudFlare Pro for $20/month.
Every hosting company I know provides dedicated IP for SSL so the only issue here is the additional cost.
You guys are paying $100/month for Moz so might as well add another $20 (per domain) and forget about it
Happy to give some guidance with the setup if anyone isn't technical, you should also be able to switch the DNS with zero downtime.Cheers,
Lucas -
Hi Lucas,
It is possible with most hosting providers, we use Google Cloud Platform and i believe it's possible there. But it involves changing all the certificates from all sites (Our site runs on 12 domains), it's a lot unnecessary work.
Cheers, Roel
-
Hi Roel,
I totally agree with you, but Moz seems to be really slow to move on this (it's been over 4 years since python released SNI support).
If you really want to use Moz I would strongly suggest just making the changes on your CDN instead of waiting for them to make a move, and you can always revert the setup once they release SNI support.
Google Cloud supports dedicated IP (they call it a VIP - virtual IP) and it costs $39/month.
You can find some info on how to setup here, I have never done it but seems pretty straight forward
https://cloud.google.com/appengine/docs/python/console/using-custom-domains-and-ssl -
Hi Lucas,
I am using cloudflare and can't get moz crawler to run even though I have disabled browser integrity and flushed cache. Is there anything else you had to do to have this work?
Many thanks
-
Hi Rodrigo,
You need to be on CloudFlare Pro which is $20/month to get a dedicated IP address for SSL which will solve your problem.
You don't need to disable browser integrity but you might need to wait a few minutes until CloudFlare adds the IP to your domain. You can check it with a tool like https://www.whatsmydns.net/ -
Hi Lucas,
Thank you for the quick response. I am using cloudflare plus at moment, and I do have a dedicated IP and SSL with my hosting provider. Would that not be the same as above? I used the dns tool and I do get a constant IP address.
Again, thank you very much for helping on this! - I understand it is not your duty to do so.
-
Sorry Jorge, not sure why I called you Rodrigo...
No worries, happy to help, it drove me crazy tooSo, I reviewed my CloudFlare settings, I got firewall security level set to low, no mobile redirect but I do have a redirect on HTTP to HTTPS on all pages.
I also have IPv6 on although I doubt that would make any difference.What I can off is that your application might be blocking the requests maybe, not CF.
Do you run custom code or is it an off the shelf solution like Wordpress?
And do you run it on AWS? EC2 instances or though an ELB?I would suggest as your next step to check if you see any requests from Moz to your server
Just trigger a Crawl test on this link and wait a few hours, you will get the report by email
https://moz.com/researchtools/crawl-testLet us know how it goes
-
Hi Lucas,
You're definitively not going crazy about my name! My business partner created the Moz account and I just changed the name of moz profile to mine as I'll be managing this..hence the confusion.
I am running a wordpress install hosted with siteground and paid for cloudflare plus via siteground, all the site redirects to https as well, no mobile redirect.
I just activated IPV6 compatibility, HTTP/2 + SPDY, set firewall security level to LOW and gave the moz crawl test a try, I'll post my results tomorrow.
By the way, I just took a look at your site and I'm impressed, it's awesome, my website is a local job portal so there's a few good features you have I'm jealous about! I'm not a designer so we went with a "premium" wp template and started tweaking from there. Out of curiosity is your site a custom design solution or is there a way I can get my hands on that theme?
Many thanks again,
Jorge
-
UPDATE: Nope, it didn't work, the CSV file from Moz has only one entry which is the 804 https error.
, have you any other suggestions to tweak cloudflare for this? -
Hey Jorge,
Sorry to hear that mate. I remember my first tests failed too, how long has it been since you upgraded to CloudFlare Pro (you said Plus but I cannot find this plan on their plan list)?
Moz has a DNS cache on their side to speed up the requests which took a week to refresh on mine. Maybe just wait a couple of more days and give it another go.
I remember giving up and then one day, out of the blue, it started working and it's been like that since.Regarding the theme, glad you liked it! But yes, it's fully customized. We started with a bunch of plugins but now we pretty much just have our custom plugin which is deeply integrated with the theme, also customized. We based it off Underscores but I don't think there is much code left from it either.
Is your site empleostampico.com? The css isn't loading for me in AU, neither the js or the images.
Wondering if it's something to do with that. -
Workable Patch
It's not beautiful, but by doing the following you can get a successful Crawl while still using Cloudflare.
Note: It seems that Moz uses their own internal cache of data, so you'll need to wait until it is 48 hours since Moz last tried to crawl your site, or Moz might grab it's own internal data (error and all), without even trying to check the live site.- Go to your Cloudflare overview and select the domain you want.
- From the domain "Overview - Status", select "Advanced" and choose "Pause" - this temporarily causes Cloudflare to funnel all traffic right back to your primary host. So you won't get any Cloudflare benefits while it is paused, but it should also pause and resume without any complications.
- (optional) If you are using a local caching program that runs off of your website (like Rocket/W3) clear the local cache for your site.
- (optional) wait 5-10 minutes. Not sure if this is needed, but if you jump right to step 5, there is a chance(?) that Moz's server might be routed through a Cloudflare server that has not yet implemented the pause.
- Run a Manual Crawl Test via Moz
- Wait until the crawl test has completed. It can take an hour or longer. Longer is better since an 804 error means less for Moz to do. You can refresh the page to see if it's done.
- Un-pause/Resume Cloudflare
- Download your results from Moz
As step 8 implies, you'll be getting a spreadsheet of results versus seeing it in you campaign, which isn't the best thing, but it's something.
Note: Not recommended, but to get the results visible within your campaign you could look at when Moz will next automatically crawl your site, and try and Pause Cloudflare for the date that this is going to happen. Sure would be nice to have a "force recrawl" option within the campaign.
-
Hey Jansen,
A few tips from me, hope it helps:
1. You don't need to pause CloudFlare completely, you can go into DNS and change the orange "cloud" to a grey one which will disable CF only on that record
2. Initially I thought about creating a new record for Moz which I could use for indexing (i.e. moz.yourdomain.com) but that will lose all search ranking records so not a good idea
3. Moz definitely works with CF + SSL, I have Moz it working on theright.fit domain, I reckon with a bit more help and testing we can get to the bottom of it, if you got time let's put together a complete list of settings and see where mine differs from yours
4. The domain has Mirrage ON, RocketLoader OFF and Minify ON (all options) -
This has been an issue going on a year now. We host over 100 clients, and have a handful in Moz. As SSL comes due, we're switch over to CloudFlare SSL for price and ease of management. And it's no longer just CloudFlare now. GoDaddy, Google, AWS, and a handful of others are all doing using SNI. When is Moz going to support this? Is it time to start looking for another solution for crawling?
-
Hey everyone,
So I use godaddy's managed wordpress, and I use a standard SSL. What must I do to have moz crawl my site?
If I ask for a dedicated IP will that fix my issue?
Any other steps to take?
Thank you!
-
Ridiculous that SNI still isn't supported. All sites behind CloudFlare, CloudFront etc. are uncrawable by Moz right now. All browsers except IE on Windows XP and the default browser in Android 2.0 supports SNI. A dedicated IP on CloudFront is $600, a non option for just Moz to be able to crawl.
-
It's been a year now since this was posted, and I'm sure this isn't the only thread and support ticket to bring this to Moz' attention.
How long is this going to take to resolve? What stupid product costs $100/month (minimum) and doesn't support modern browser and SSL standards? Oh wait, I guess that's why I'm responding to this.
-
This post is deleted!
-
0483
-
0272
-
0278
-
04486
-
02183
-
04372
-
031.6k
-
0287