Our crawler was not able to access the robots.txt file on your site

[DigitalButter]

I've submitted my website to be crawled by Moz and done everything I can according to the troubleshooting guides. Please help!

https://digitalbutter.co.za/robots.txt

[dave.kudera]

Hi - Thanks for reaching out.

When I tried to curl your robots file from our user-agent string, I was redirected 50 times (then timed out as max redirects). My guess would be you have some type of bot protection with Cloudflare. You can reach out to your hosting admin and have them locate "rogerbot" in the logs. They will need to most likely whitelist our crawler to access the site.

If you need further assistance with this, please reach out to help@moz.com directly, and we can assist!

Thanks!

[DigitalButter]

Disabled my CDN and it worked!

Thanks so much!