Does Moz's crawlers use _escaped_fragment_ to inspect pages on a single-page application?

[CareerDean]

I just got started, but got a 902 error code on some pages, with a message saying there might be an outage on my site.

That's certainly not the case, so I'm wondering if the crawlers actually respect and use the escaped_fragment query parameter.

Thanks, David.

[jameskais]

Hi CareerDean,

At this time we are not supporting escaped_fragment for crawling websites and our crawler rogerbot will simply hit anchor tag links. I was able to take a look at your site and rogerbot will definitely have some trouble crawling anywhere here due to the lack of a hrefs.

What we have typically suggested in the past is using an HTML link at the bottom of the page leading to a basic site map so that Roger can navigate through. This will allow you to keep the same look and feel and just add one link to enable crawlers.

Please let me know if you need anything else and feel free to get us at help@moz.com with any further questions. Also feel free to ask any follow ups here as well.

[CareerDean]

This post is deleted!

[CareerDean]

Hi James,

I can also serve the pre-rendered, static version of the website to Moz's bots. In order to detect the bots, I'll have to scan the User-Agent string.

Is it safe / enough to look for "rogerbot" in the User-Agent string?

Thanks, David.

[jameskais]

David, yes you can serve that as a solution as well and the User-agent string will be rogerbot. Sorry for any confusion this caused on your end. Once you get this up and running Roger will crawl like there is no tomorrow!