Moz Not Crawling Angular SPA

[PIN_Celler]

I have a client that just launched a redesigned website using Angular as a single page app. Google appears to be able to crawl the site just fine, but Moz crawl is only finding one page. We have updated the htaccess to allow for Rogerbot and Dotbot, but still unable to crawl any pages other than the home page. Does anyone have experience with this or ideas of why it won't crawl all pages, and how to allow for Moz to crawl all pages? There is a sitemap with approx. 390 pages.

Thanks!

[tawnycase]

Hi there! Tawny from Moz's Help Team here.

Thanks for writing in and sorry about the trouble!

I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. It looks like, due to the Javascript on the page, we weren't able to find any links to keep crawling: https://www.screencast.com/t/mqy7SUb9f

There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub.

While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.

You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.

I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. If you have any follow-up questions or if there's anything else you need help with, please write in to help@moz.com and we'll do our best to sort everything out.

[PIN_Celler]

Thank you very much for your quick response. I'm taking a look at the Q&A section and the tools you recommended. I appreciate your help!

[AndersS]

Hi!

One way to get around this one is making use of pre-rendering. So if you setup your site/server to pre-render your pages either for all user agents, or specifically for MozBot and other bots not capable of crawling through JavaScript then it might work.

Facing the same issue for us now, but will try this at least.

Best regards,
Anders

[Kevin_P]

I recommended to another Moz agent that it put a clearer warning label to users that Moz Pro's on-page grader and site crawl will not work with single page apps. Alternatively, I'd have a pop-up if the Moz tools run and come up with results like the ones the poster described. I ran into the same issue.