Thanks.
But from what I read elsewhere, and what I am seeing I think it is unrelated to rogerbot being caught in the firewall and more likely a https SSL certificate issue.
Welcome to the Q&A Forum
Browse the forum for helpful insights and fresh discussions about all things SEO.
Thanks.
But from what I read elsewhere, and what I am seeing I think it is unrelated to rogerbot being caught in the firewall and more likely a https SSL certificate issue.
Just to add, I managed to run a site crawl (the one with the downloadable csv file) so clearly it is just related to the on-page grader.
Also, rather strangely other sites on the VPS work fine (http).
Therefore I am thinking more and more that it is an SSL intermediate certificate issue.
Yeh, that question at http://moz.com/community/q/onpage-grader-says-site-unreachable
is not actually answered even though someone has marked it as such. Don't know how to mark it as not.
Just annoying, as it may prevent someone else chime in with new information now I have updated it with some more info myself as I am just trying to get this resolved.
Yeh, that answer was not very helpful, although it contained useful information.
My working theory is that as I just transferred the site to one of my VPS that the SSL doesn't have a valid intermediate certificate. I will have a closer look at resolving this tomorrow.
It probably didn't help that I was not accurate with the error message which states that "sorry but that url is inaccessable".
Well, my host cannot check without IP's and from what I read Moz doesn't give out IPs as they are dynamic.
I guess that leaves me stuck unable to use this service.
It is possible the crawler is caught in the firewall. Any idea what I need to have whitelisted?
Aman,... well what you are doing is creating thin pages which over time might just risk a Panda Penalty. You might want to at least no-index those blog pages.
Why not just use rel canonical?
Why are your blog pages, just an image of a photocopy of someone elses article. You realise Google can't read the text from Images for SEO purposes right?
I have great success filing a DMCA with google when this happens. The process is easy, and can be done here:
https://www.google.com/webmasters/tools/dmca-dashboard
From my own experience it will take them 3 or 4 weeks to process it, but I have been successful every time.
When I first started doing SEO, I did small niche sites, and to some extent I used exact match domains. Furthermore, I dabbled in the old black hat arts as well.
I can tell you that merging multiple sites into one was the best thing I have done (well, that and going completely white hat). You can save so much time only focusing on one site, that you can spend alot more time creating better content, and like you say more time increasing the authority of one site rather than having to split your attentions over three.
Sure, you may find in the short term that you don't do so well, but if you are wanting to think ahead and consider how you can expand even more with related topics and better ranking through a stronger domain authority then I think migrating into one site could well be worth considering.
Are you able to share a link to the page in question?
I would suggest you find a new host. I know that is the obvious answer, but probably the easiest. If you have cPanel, many hosts will transfer everything across for you.
If you are doing a link cleanup I highly recommend cognitiveseo. It takes all links from Moz, ahrefs, majestic as well as allowing webmaster tools imports. You can categorise your anchor texts, and it will run its own system and recommend links to disavow which you can manually review.
On top of that, it will also create the disavow file for you. Saved me a alot of work when I got hit by some negative seo.
John Mueller Webmaster Central Hangouts. Learnt quite alot from these hangouts over the last few months, and you can also submit your questions to be answered.
There is a new Doorway pages algorithm coming that could potentially catch this kind of optimization out. Unfortunately, until it is released it is difficult to say how severe it will be.
You can read more here:
http://googlewebmastercentral.blogspot.co.uk/2015/03/an-update-on-doorway-pages.html
https://www.besthostnews.com/google-updates-doorway-pages-algorithm-march-2014/