Blocking all robots except rogerbot

[ignician]

I'm in the process of working with a site under development and wish to run the SEOmoz crawl test before we launch it publicly. Unfortunately rogerbot is reluctant to crawl the site. I've set my robots.txt to disallow all bots besides rogerbot.

Currently looks like this:

User-agent: *
Disallow: /

User-agent: rogerbot
Disallow:

All pages within the site are meta tagged index,follow.

Crawl report says:

Search Engine blocked by robots.txt Yes

Am I missing something here?

[StalkerB]

You've made it upside down

Roger sees the first * and then goes "okay :(" and goes away.

Simply change it to:

User-agent: rogerbot
Disallow:

User-agent: *
Disallow: /

[KeriMorgret]

And if that still doesn't work, email help@seomoz.org and they'll help you figure out the right way to let Roger in while excluding everyone else.

[ignician]

Thanks, it appears to be crawling without issue now

[ignician]

...actually I take that back. Still reporting as blocked by robots.txt.

Going to email the team.