NEW Robot crawl blocked

[Libra_Photographic]

I have two sites that currently sit as having the MOZ crawl blocked.

libraphotographic.co.uk & wildwaybushcraft.co.uk

Both have valid robots files (wordpress) and had no issues with the old site crawl.

Has anyone else has this issue? and has anyone found a solution?

[LoganRay]

I have a site that regularly won't let Moz crawl the site. After digging into the issue and reaching out to Moz support, I determined that the site's hosting provider is a little overzealous with their security settings and have been blocking Moz's user-agent at the server level. I'd start by looking into that.

[Libra_Photographic]

yes I've been talking to my host about that. The crawl has worked for the past year though, its just the last version that is an issue. No rogerbotbeing blocked either in the log.

We'll see were it goes from here.

[Libra_Photographic]

Turns out the format of the robots.txt file needed to be listed as UTF8 in my .htaccess file. All working now.

That was a wasted week playing with security etc but I have to give it to the MOZ CS. they didn't give up.