Error Message on Moz Crawler

[Dushala]

Hi all,

Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?

It seems to be working fine on other SEO analyser tools.

Website is: www.sbpcreativemedia.com.au

Thanks in advance!

luXS8V5

[jocameron]

Hi there,

Thanks for reaching out!

It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.

I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.

Thanks for bearing with me!

Jo

[jocameron]

Hi there,

Jo again from the Moz help team.

I'm afraid we're still getting a 520 error when we try to access your robots.txt.

In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.

Please send your server logs to help@moz.com.

Cheers!
Jo

[Dushala]

Hi Jo,

Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.

Thanks again