Questions
-
Is there a easy way to see what pages are crawled?
Thanks! I was just wondering how it would be here in SEOMoz, Matt already helped me!
Moz Pro | | MattDG0 -
Can I prevent some pages from being crawled from SEOMoz spider and still not affect Google Spider?
Hey Martijn, Thanks! What about if I want to avoid rogerbot from crawling a range of pages from let's say /000001/; /000002/... /200000/ ? Thanks!
Moz Pro | | MattDG0