Yahoo Slurp Bot 3.0 Going Crazy

[tony-75534]

On one of our sites, since the Summer, Yahoo Slurp bot has been crawling our pages at about 5 times a minute.   We have put a crawl delay on it and it does not respect our robots.txt.    Now the issue is it's triggering javascript (which bots shouldn't) triggering our adsense, ad server, analytics information, etc.

We've thought of banning the bot all together  but get a good amount of Yahoo traffic.   We've though about programmatic-ly not showing the javascript (ad + analytic) tags but are slightly afraid the Yahoo might consider this cloaking.

What are the best practices to deal with this bad bot.

[AlanMosley]

Bots do folow javascript links these days, maybe yahoo have jsut started to do so, maybe they are not doing so well at it.

I would contact Yahoo and try and get some answers.

[tony-75534]

I've searched the web but cannot find a specific support location.   Any suggestions or links.