Robots User-agent Query

[ThomasHarvey]

Am I correct in saying that the allow/disallow is only applied to msnbot_mobile?

mobile robots file

User-agent: Googlebot-Mobile

User-agent: YahooSeeker/M1A1-R2D2

User-agent: MSNBOT_Mobile

Allow: /

Disallow: /1

Disallow: /2/

Disallow: /3

Disallow: /4/

[donford]

Hi Thomas

Unless I'm mistaken. If you list multiple user agents before a rule all the users agents are subjected to the rule.

So what you have is a list of 3 user agents allowed "anything" disallowed 4 specific things.

In the end the rules apply to all.

Don

[Guest]

This post is deleted!