Robots txt is case senstive? Pls suggest

[Rahim119]

Hi i have seen few urls in the html improvements duplicate titles

Can i disable one of the below url in the robots.txt?

/store/Solar-Home-UPS-1KV-System/75652
/store/solar-home-ups-1kv-system/75652

if i disable this

Disallow: /store/Solar-Home-UPS-1KV-System/75652

will the Search engines scan this /store/solar-home-ups-1kv-system/75652

im little confused with case senstive.. Pls suggest go ahead or not in the robots.txt

[GastonRiera]

Hi Abdul,

Yes, it is case sensitive.

Remember that you must not have many pages like that. 
The first thing you should do is elimiate those duplicate pages.

In the case you can´t eliminate them, you have 2 way to ask the google bot not to index them:
1- By robots.txt with a 'Disallow:' instruction
2- By a meta tag with a_ '' _in the

Hope it helps.
GR

[netzkern_AG]

Actually, you have just one option to not index them - the second one. The first will, still keep them in index if google can find them. I currently have roughly 27k URLs indexed that were blocked via robots.txt from the start (generated with a time-based parameter; yeah: ouch.).

Those results do not usually appear in "normal" search but can be forced (currently you may try site:grimoires.de inurl:fakechecknr and showing skipped results to see the effect of that). So basically I'd advise against using robots.txt - it does not prevent indexing, only the visiting/reading of that page.

Regards

Nico

[Rahim119]

Hi Already there is some equity for duplicate links, wht is going to happen?