Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Questions

Does the Moz crawler ignore the robots.txt file?

Hey there! Thanks for reaching out to us! Our Crawler does obey robots.txt directives. Would you be able to reach out to us at help@moz.com so that we can do some investigating. I.e. So we can access your Campaigns and take a look at your website etc. Looking forward to hearing from you, Eli
Other Questions | | eli.myers

0