Two Robots.txt files

[TrulyTravel]

Hi there

Can somebody please help me that one of my client site have two robot.txt files (please see below). One txt file is blocked few folders and another one is blocked completely all the Search engines. Our tech team telling that due to some technical reasons they using second one which placed in inside the server and search engines unable to see this file. www.example.co.uk/robots.txt - Blocked few folderswww.example.co.uk/Robots.txt - Blocked all Search Engines I hope someone can give me the help I need in this one.

Thanks in advance!

Cheers,
Satla

[GastonRiera]

Hi,
I don't find any good reason why there are two files. There should be just one, where you specify everything you'd like to done.
If the tech team doesn't want to correct and leave just one file, may be because they are lazy or there might be some other issue that if they delete one file, the hole site blows up.

Here, I leave you 2 Moz's articles about the robots.txt file.

What is Robots.txt? - Moz Learn
Learn About Robots.txt with Interactive Examples - Moz Blog

Take into account that the name of the file must be in lower case. I've never seen any different and the servers are usually case sensitive with the filenames.

Hope its helpful.

GR

[LoganRay]

Hi Satla,

You're going to need to get rid of that 2nd version ASAP. The official standard for a robots.txt file is all lower case in the file name, so that's most likely what bots are seeing. But to err on the side of caution, I'd remove any possibilities of a "disallow: /" and remove that Robots.txt version.

Some servers are case sensitive, so you could run into issues here as well.

[Alick300]

Hi Satia,

You mentioned that one robots.txt file placed in inside the server and search engine unable to see the file. If search engine won't see robots.txt file then what is the use of that robots.txt file?

AFAIK it must be placed under root directory an there is no way to keep two files with the same name. So you must have only one robots.txt and that should be placed under root directory.

Hope this helps.

Thanks

[TrulyTravel]

Thank Riera