Google bot index

[wetpaintshirts]

This post is deleted!

[josh-riley]

It's harder to get stuff out of index once it's there - sorry to hear this happened. You can submit URLs to Google Webmaster to remove. (Google Webmaster Tools>Optimization>Remove URLs.) I'm not sure if you can do them in bulk or if it has to be one by one.

Do you have an updated sitmap (with the URLs you want indexed) uploaded to your Webmaster account? resubmit it to help tell Google to come back to your site to crawl.

(Adding the appropriate robots.txt and tags can help prevent this from happening again: http://www.brighthub.com/internet/google/articles/69244.aspx, http://www.seomoz.org/blog/logic-meet-google-crawling-to-deindex)

[wetpaintshirts]

This post is deleted!

[Brian-H]

From my experience it doesn't hit you with a duplicate penalty for this however it's terrible for user experience to arrive on a price filtered page.

Once you submit parameters to google webmaster tools it does work its way through but can take a long time.

Faster is if you can rel-canonical tag the filtered pages to the main page. That seems to get rid of them on the next crawl.

Brian

[wetpaintshirts]

This post is deleted!

[Dr-Pete]

With that kind of complexity, there's rarely just one answer, and I'd hesitate to use rel=canonical for every problem. For search pagination, for example, rel=prev/next is probably a better choice. I've got a huge post on the topic here that shows just how complex it is:

http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world

A combination of META NOINDEX and rel=canonical can be a big help for the rest, but it depends a lot on the situation. Do you have a sense of what the worst culprits are? If you can start with the ones causing 50K+ indexed pages each, you don't have to necessarily solve everything at once.

Don't implement multiple solutions for any given problem - it can do more harm than good. Also, be aware that deindexation takes a while - sometimes a long while. I know that's frustrating, but just because 500K pages don't drop out of the index tomorrow doesn't mean what you did isn't working. It can take 1-2 weeks just to see them start to fall. Don't make a change and then reverse it in 48 hours, or you can cause even more long-term damage (believe me, I've seen it).