Can Google see all the pages that an seomoz crawl picks up?

[Chammy]

Hi there

My client's site is showing around 90 pages indexed in Google. The seomoz crawl is returning 1934 pages.

Many of the pages in the crawl are duplicates, but there are also pages which are behind the user login.

Is it theoretically correct to say that if a seomoz crawl finds all the pages, then Google has the potential to as well, even if they choose not to index?

Or would Google not see the pages behind the login? And how come seomoz can see the pages?

Many thanks in anticipation!

Wendy

[NakulGoyal]

Wendy, if SEOMOZ can see it, I am sure Google can see it as well. I would login to your webmaster console and check the index status. Do you have an XML sitemap submitted for your website ? Once you do, you'll have a more accurate read on the number of pages you submitted and how many of them are indexed. The new index status Google introduced last month also lets you see pages Google ignored for multiple reasons.

I hope this helps.

[Chammy]

Great, many thanks Nakul - they are a new client so am waiting on getting access to WMT - will go through with a fine tooth comb! Just seems really weird with regards to the pages behind the login ...

[UnderRugSwept]

Here's the real question: Do you WANT Google to see all these pages, or is SEOmoz crawling unnecessary pages?

[Chammy]

Hi Marisa

seomoz are crawling unecessary pages, (they return pages ignored by screaming frog for example)

BUT my concern is that if Google can also see them, even if they choose to ignore them my client maybe getting slammed for duplicate issues or the pages behind the login may suddenly appear in the index.

We'll get no index / no follow added, and fix the dupes, but am really interested as to how seomoz sees behind the login

[UnderRugSwept]

This may be an obvious question, but to you have those pages set to noindex?

[Chammy]

The pages behind the login? No not yet - they are a new client, so I am just auditing at the moment to identify what we need to do

Many thanks for your replies!

[UnderRugSwept]

Well, that could be your easy solution. Make sure they're all set not to be indexed, then you'll be able to (mostly) ensure Google won't crawl them, and they'll probably disappear from your moz crawl report as well. As far has how moz is finding them to begin with behind your login wall, sorry, I have no idea.