Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?

[Felix_LLC]

MOZ is currently blocked from crawling my sites because I use a bot sniffer.

Does anyone know how I can properly identify the MOZ bot in order to whitelist it?

MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.

[LynnPatchett]

Hi Matt,

The user agent is called rogerbot, you can see a reference to it here (towards the bottom of the page).

[Felix_LLC]

Hi Lynn,

I was under the impression that it's really insecure to whitelist based on useragent.

Thanks,

Matt

[LynnPatchett]

Hi Matt,

Sorry maybe I misunderstood your question... I thought that was what you are after. How/What exactly is currently blocking the moz bot then?

[Ryan_Watson]

Hey Matt,

Thanks for the question! As Lynn mentioned above, Rogerbot is our user agent, so that is your best option. We use a wide variety of IPs in our crawling that are constantly changing, so there really isn't any IP range that we can provide that will always work.

Cheers,

Ryan Watson
Business Development Associate | Moz

[Felix_LLC]

Hi Ryan,

We only block by specific IPs because anyone can spoof a user agent. While i honestly appreciate your effort, could you please put me in touch with someone on the dev side.

Best,

Matt