Does Rogerbot respect the robots.txt file for wildcards?

[AC_Pro]

Hi All,

Our robots.txt file has wildcards in it, which Googlebot recognizes.  Can anyone tell me whether or not Rogerbot recognizes wildcards in the robots.txt file?

We've done a Rogerbot site crawl since updating the robots.txt file and the pages that are set to disallow using the wildcards are still showing.

BTW, Googlebot is not crawling these pages according to Webmaster Tools.

Thanks in advance,

Robert

[KeriMorgret]

Roger should obey wildcards. It sounds like he's not, so could you tattle on him to the help team and they'll see why he's not following directions? http://www.seomoz.org/help Thanks!

[OlegKorneitchouk]

Yes, rogerbot follows robots exclusion protocol - http://www.seomoz.org/dp/rogerbot

[AC_Pro]

Thanks!  RogerBot is now working.  Perhaps it had a cached copy of the old robots.txt file.  All is well now.

Thank you!