Moz site crawl showing duplicate page titles but webmaster tools doesn't

[andgee28]

This post is deleted!

[VERBInteractive]

The Rogerbot might just be a bit behind compared to the Google bot. Do you know the dates of the last indexation of both? It might also be that the google bot is able to recognize that the pagination pages don't need to be indexed. Although I'm sure the Rogerbot is rather advanced, I highly doubt it is at the level of the bot that indexes the majority of the internet for the search engine used by the majority of people.

Just so all of your bases are covered, I would suggest noindex on the all of the pagination pages (excluding the first of course). Avoid nofollow since you still want indexing bots to crawl these pages and dig deeper into your site.

I hope that helps.

[moz_support]

Hey Andrew!

It's hard to determine exactly what's going on here without looking at your crawl results. Our crawler is a bit more sensitive than Google's to help identify any potential SEO issues, so it's possible that's what's happening, but it could also result from trouble reading the page in question or some other issue. If you'd like help identifying what's going on, I would recommend reaching out us at help@moz.com!

[andgee28]

Thanks that's what I'm leaning towards at the moment.  Is there ever a case where you wouldn't use a noindex on subsequent pages for an ecommerce website that lists a large amount of products paginated?