Thanks a lot for such useful suggestions.
" It is a lot healthier to have a site that can be crawled more easily by the search engines."
Do you mean that search spiders won't crawl the site easily becaise of spiders ?
Also, where do you find duplicate content on the site.