Can anyone help me understand why google is "Not Selecting" a large number of my webpages to include when crawling my site.

[Jdubin]

When looking through my google webmaster tools, I clicked into the advanced settings under index status and was surprised  to see that google has marked around 90% of my pages on my site as "Not Selected" when crawling.  Please take a look and offer any suggestions.

www.luxuryhomehunt.com

[StreamlineMetrics]

Hmm, I just tried to click on a listing in Google but I was served a popup which required that I enter in my contact information before I could access the site http://luxuryhomehunt.com/view-property/40096215. Did you just add this pop up? Since there is no way for users to opt out of entering in contact information to view a listing, then it may be possible that the search engines are being blocked as well.

I also tried crawling the site with Screaming Frog SEO Spider and Xenu, but my connection was refused... not sure if my IP was blocked or if the site is blocking crawlers, but my guess is the search engines may be having some trouble accessing all of the pages on your site.

At the very least, I'd recommend removing that popup since it's bad for user experience and may be causing problems with the search engines.

EDIT - I did some more digging and looked the Google cache for one of your listings - http://webcache.googleusercontent.com/search?q=cache:L6LzTqj9gQUJ:luxuryhomehunt.com/view-property/40445850+&cd=6&hl=en&ct=clnk&gl=us&client=firefox-a. On this page, you have the rel="canonical" tag set to http://luxuryhomehunt.com/view-property so that tells the search engines that all of your property listing pages should use that canonical URL, which explains why most of your pages are "Not Selected" per Google -

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=2642366

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=139066

[Jdubin]

Thanks for the response.  The pop up is running in java, and from what I have been told  search engines can crawl pages so long as the opt in is running in java.  Typically a visitor would hit one of our landing pages such as http://luxuryhomehunt.com/homes-for-sale/Longwood/alaqua-lakes.html where they can find information about the specific community they are searching for then if they click on a listing they would be prompted to opt in.

Do you think there may be any correlation to me using or not using canonical tags?  Another thing I was wondering is if it has anything to do with, my handling of pages 2,3,4,5 etc of a city or community with more than ten listings.

I am not sure as to why your connection would have been refused, I am currently running a xml sitemap generator and maybe that had something to do with it.  Either way, I am super grateful for your help and for you looking at this.  I am very new to SEO and trying to learn my way through as much as possible.

[Jdubin]

Thank you. Thank you. Thank you.  That makes so much sense.  This is also the issue I am having with my communities and cities pages, pointing at my http://luxuryhomehunt.com/homes-for-sale page.

Does that make sense?