Welcome to the Q&A Forum

If the cron is working then I would personally turn to the other forum to see if anyone knows a way to rope those messy URLs in and get them under control. I try to avoid manually generating and updating sitemaps whenever I can, because it's a hassle on a small site, not to mention the trouble on an ecommerce site. If your site is going to stay that small, then a manual sitemap might be less of a headache for you than customizing Magento. I would worry about keeping a clean sitemap. If the search engines learn that you keep a messy sitemap, they will rely on it less and less. 404 & 500 codes especially, but also redirects and perhaps duplicate content. For Further Reading: Google Sitemaps Ask For Clean URLs - http://www.johnfdoherty.com/google-sitemaps-ask-for-clean-urls/

If you have the canonical in your page (www.mysite.com/acategory/niceproduct.html) then you dont need to bother making the title unique as google will index the set canonical page as the ruler over the duplicated and use all that information.

Rasmus, They one you have provided does not allow you to generate a graphical sitemap from the XML file so it's pretty useless when scanning website with 1000+ dynamic URLs and power mapper does not have an option to ignore /categories or /page=  alike.

Hi, I'm personally recommend Google Custom Search. It works great for me. Also You can find in Google many search scripts for most popular platforms(php, .aspx etc). Their will help if you don't want add you pages in Google index, or have private segments on site (personalized by the way)

Excel has a feature called advanced filters that I use to filter these out.  See here for more info: http://office.microsoft.com/en-us/excel-help/filter-by-using-advanced-criteria-HP005200178.aspx.  It allows you to filter your data by multiple criteria.  You might have to break up your regex a bit into multiple different filters, but you should be able to get it done with this.  They support * and ?. If you use Google Analytics, you could view this by setting up an advanced filter with a regex to separate branded vs. non-branded paid search queries.

In addition to David's comment, it also can't hurt to use the title attribute of the anchor tag itself, eg: [image: ...] We use title attributes extensively in our site(s) for alternate and/or more verbose phrasings of keywords.