Why are only two pages of my site being crawled by MOZ?

[hrparts]

MOZ is only crawling two pages of my site even though there are links on the homepage, and the robot.txt file allows for crawling.  Our site address is www.hrparts.com.

[lauren.s]

Hi there!

Thanks for writing in and sorry about the trouble!

I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript.  Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.

Our crawler works by parsing the source code of your site, looking at HTML elements.  If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.

While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.

You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.

https://www.onely.com/tools/wwjd/ is also a handy tool that makes it super easy to see where links are added or removed by javascript.

I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!

[hrparts]

Thank you for your response, Lauren.  Our site only has one major feature that is in Javascript, but the rest of the site is not.  We do have a 301 redirect from hrparts.com to  www.hrparts.com which is where  I believe the issue might be coming from.  I am curious whether MOZ has an issue with a 301 redirect in a campaign?

[hrparts]

I had to remove subdomains from being crawled on the site, and the issue has been resolved.  The 301 redirect was an issue, causing MOZ to stop crawling at only two pages, the http and https pages.