Getting pages indexed by Google

[caneja]

Hi SEOMoz,

I relaunched a site back in February of this year (www.uniquip.com) with about 1 million URL's.

Right now I'm seeing that Google is not going past 110k indexed URL's (based on sitemaps).

Do you have any tips on what I can do to make the site more likeable by Google and get more indexed  URL's?

All the the part  pages can be browsed to by going to: http://www.uniquip.com/product-line-card/suppliers/sw-a/p-1

I've tried to make the content as unique as possible by adding random testimonials and random "related part numbers" see here: http://www.uniquip.com/id/246172/electronic-components/infineon/microcontrollers-mcu/sabc161pilfca

Do I need to wait more time and be more patient with Google? It just seems like I'm only getting a few thousand URL's per day at the most.

Would it help me  if I implemented a breadcrumb on all part pages?

Thanks,

-Carlos

[Trupanion]

Carlos,

There is a great thread you should read about this topic: http://www.seomoz.org/q/can-you-push-too-many-urls-via-sitemaps

As for me, I would recommend creating multiple XML sitemaps where you can track which urls are bing indexed and to also control the submission quantity.  You don't want to publish a ton of urls at one time.  For the urls that aren't in Google's index, I would no index them for now and slowly submit a small group on a monthly basis, along with different XML sitemaps for tracking.

You have to think as if you were Google, is the content you're submitting valuable and new information?  There is no way that 1 million new pages is so valuable or new that isn't already out there.  A nice steady submission stream will give you the best results in the long run.

I hope this helps.

[evolvingSEO]

Hi Carlos

It appears there are two major issues with your site not getting indexed.

1. Off-Site - Go to opensiteexplorer and type in your URL.  You will see there are many suspicious looking links pointing back to your domain.  No matter what you do on-site, if you have really low quality backlinks pointing to your domain (and no good ones to balance things out), nothing you do on-site will help.  You'll want to do whatever you can to clean these up (get them removed).  You'll also want to work on getting some GOOD backlinks in conjunction with cleaning out the bad ones.  There are many resources here on SEOmoz on backlinking strategies.

2. On-site - Your product pages are 4 or more clicks away from the homepage.  You really want this to be 3 or less (ideally 1 if possible for some products and categories).

I also noticed that your homepage does not appear to be indexed in Google.

We could go WAY more in depth with this, but in general those seem to be the two major issues.

-Dan

[caneja]

Thanks for the feedback Brent.

I already my sitemaps setup in groups of 30k with a master sitemap file. http://www.uniquip.com/sm/smindex.xml

I will talk to the developer so we can look into regrouping them and perhaps pickup an indexing pattern.

[caneja]

Thanks for both tips Dan, I will look into them althought number  2 may be a bit tough.... since there are hundreds of suppliers/categories (bit tough to put in a menu).

as for the page not being indexed I'm showing that it is. http://webcache.googleusercontent.com/search?sourceid=navclient-ff&ie=UTF-8&q=cache%3Ahttp%3A%2F%2Fwww.uniquip.com%2F

is this not the case for you?

[evolvingSEO]

Carlos

Actually, it is in the index but if you do: site:www.uniquip.com as a search in Google it is not the first result, which it should be.  If you do "site:www.uniquip.com" (with the quotes) as a search in Google, it is still only the second result, it should be the first, which is a sign that something is weird, which would require some more investigation.

-Dan