Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Robots.txt

Technical SEO Issues

3 3 642

Log in to reply

PeterM22 last edited by

Hi everyone,

I just want to check something. If you have this entered into your robots.txt file:

User-agent: *
Disallow: /fred/

This wouldn't block /fred-review/ from being crawled would it?

Thanks
1 Reply Last reply
Reply Quote 0
USHoleInOne last edited by

/fred-review/ would be fine, as long as they are a separate directory you should have no problems.
1 Reply Last reply
Reply Quote 1
Entrusteddev last edited by

Ensure there are no re-writes active that may forward traffic from /fred/ to /fred-review/ and you should be good.
1 Reply Last reply
Reply Quote 0

Browse Questions

View

From

Sorted by

With category