Does putting Disallow: / at the end of a robots.txt file override the Allow: /xxxx that come before it?
-
This post is deleted! -
Hi,
No it won't override.
"If you put the
Disallowfirst, then many bots will see it as saying they can't crawl anything. By putting theAllowfirst, those that apply the rules from top to bottom will see that they can access that page."Thanks
-
This post is deleted! -
Yes agreed with james wolff,
If you are adding Disallow:/ at last no need to adding any other disallow.
Thanks