Does the Moz crawler have a static ip address?
-
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
-
Hi Dustin,
Unfortunately we do not use a static IP address as we have designed our crawler to have a location agnostic approach, this means we use thousands and thousands of IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web and in turn your sites.
We are moving more and more away from AWS but at this time we still use AWS to crawl certain portions.
Regards - James - Moz Help Team
-
James
I currently use Sitelock which disallows unwanted bots to crawl the site. The MOZ is unable to crawl however we can input a white list of ip addresses comming from MOZ. How are you guys going around this issue?
Raul