Welcome to the Q&A Forum

Hey there! Sorry to hear that a couple of your Campaigns are running into Robots.txt crawl issues! Maybe I can help figure out why those sites can't be crawled. It looks like the robots.txt file for the first site you mentioned is returning a 403 Forbidden response to our user-agent, Rogerbot: https://www.screencast.com/t/TFFaWtikf Anything other than a 301 redirect or a 200 OK status wills top us from being able to access the robots.txt file, which will result in a crawl failure. Please make sure your robots.txt file is fully accessible to rogerbot. For the second site, ptone.nl, we're getting a 406 Not Allowed error: https://www.screencast.com/t/np1AEJ3oDiy2 Again, we'll need to be able to access those robots.txt files in order to crawl your site. And that last site is also returning a 403 Forbidden response when we try to access your robots.txt file for that site: https://www.screencast.com/t/CEpKpLq3z I'd recommend checking in with your web developer or whoever manages your site for you. They'll probably know how to make the necessary changes to make sure that your robots.txt files are accessible to our crawler. Hope this helps! If you've still got questions, feel free to drop us a line at help@moz.com and we'll do everything we can to answer them all.