Can you edit the crawl depth on an existing Campaign?

[cr177y]

I have around 12k pages on a retail website, some pages have multiple ways to display products such a-z or price high to low. some pages can be filtered by category or brand. Moz is crawling these pages multiple times telling me they are identical content etc, which is slowing down my site. Are there settings in the moz crawler to adjust for this?

[jocameron]

Hi there!

Jo from the Moz support team here.

It sounds like you're wanting to stop rogerbot from crawling certain pages on your site. The best way to do this is to exclude rogerbot using your robots.txt file. You can read more about how to do that here

https://moz.com/help/guides/moz-procedures/what-is-rogerbot

If that's not possible for whatever reason, then I would recommend using the "Ignore" feature in Moz Pro Site Crawl, that way we won't keep reporting these issues.

​If there is anything else I can help you with please do let me know.

Cheers!
Jo