Huge Google index on E-commerce site

[ssiebn7]

Hi Guys,

Refering back to my original post I would first like to thank you guys for all the advice.

We implemented canonical url's all over the site and noindexed some url's with robots.txt and the site already went from 100.000+ url's indexed to 87.000 urls indexed in GWT.

My question: Is there way to speed this up? 
I do know about the way to remove url's from index (with noindex of robots.txt condition) but this is a very intensive way to do so.

I was hoping you guys maybe have a solution for this..

[Davenport-Tractor]

SSiebn,

I have had some success in speeding things up, but only to a point.

Google webmaster tools is a GREAT tool that fortunately for us Google allows us to use, and its free!

I'm sure you probably already use the service, but I have found a few ways to use the tools to improve their scan rate. First block the spiders from crawling any pages you don't want indexed, for instance your backend files, this allows more time to be spent on the pages you want indexed. Second ensure you pages link to each other in the site, this allows pages to be linked by flowing through to each other, (no dead ends). Third use "Fetch as Google" from WMT, you are allowed up to 10 fetches. These fetches can be configured to follow linking pages, once crawled, you may submit the results to the Google index, with up to 500 fetches. It may be beneficial to submit for "Fetch as Google" your main categories. Lastly check your "Crawl Rate" to ensure that you have chosen "<label for="recommendedType">Let Google optimize for my site (recommended)</label>"

[ssiebn7]

Hi allen Jarosz!

Thanks for your reply

I've actually done all the things you said in the last few weeks. Site is totally indexed but the main problem is that are over 85.000 url's indexed but the site only exists of 13.000 urls.
So the main question is wether i can speed things up in one way or another to get those 70.000 url's deindexed.

Are any options besides noindex, robots.txt and removing some url's ? Because now it's just waiting.

It looks like we are going the right way when you check the image.

gaHmQ54.png

[ssiebn7]

Hi,

A few weeks later now and index is now on 63.000 url's so that's a good thing.

Another weird thing is the following.

There's a (old) url still in the index. When i visit it redirects me to the new url, which is good. Cache date is 2 weeks ago but Google still shows the old url.

How is this possible? The 301 redirect is already in place since April 2013.