Onpage grader says site unreachable
-
It is possible the crawler is caught in the firewall. Any idea what I need to have whitelisted?
-
Well, my host cannot check without IP's and from what I read Moz doesn't give out IPs as they are dynamic.
I guess that leaves me stuck unable to use this service.
-
Have you considered going through your server and/or firewall logs to find out the root cause of the issue? Your host should be able to help you there, even without any IP's. Just run a crawl, and tell them approximately what time you ran it - that should be enough for them to start analyzing the issue.
The first question to find an answer to is what is blocking the crawler, followed by how is it blocking the crawler and finally, why is it blocking the crawler.
Once you find an answer to those questions, it will be vastly easier to help you find a solution.
-
Yeh, that answer was not very helpful, although it contained useful information.
My working theory is that as I just transferred the site to one of my VPS that the SSL doesn't have a valid intermediate certificate. I will have a closer look at resolving this tomorrow.
It probably didn't help that I was not accurate with the error message which states that "sorry but that url is inaccessable".
-
Just to add, I managed to run a site crawl (the one with the downloadable csv file) so clearly it is just related to the on-page grader.
Also, rather strangely other sites on the VPS work fine (http).
Therefore I am thinking more and more that it is an SSL intermediate certificate issue.
-
Just to update for people that see this question in the future. The problem was caused by the lack of intermediate certificate. Everything is now working.
-
Thanks for the update! So glad it's working now.
