Hi there,
I read a few of the earlier posts about this issue, but i can't get the problem with the crawling issue fixed (see notification below). Especially since i'm not really technical, i have no idea where to start. We have many client websites and three of them get this message. I don't see much difference between te robot.txt of the ones working and the ones not working.
Not working:
http://www.calderagroup.nl/
http://www.ptone.nl/
http://snijdersfeerverwarming.nl/
Anyone knows where to start? How to fix?
**Moz was unable to crawl your site on Oct 5, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster.
