Search Engine blocked by robots.txt

[monotero]

I do that, because i am using joomla. is bad? thanks

[wissamdandan]

If you need to Index your website and gets rankings, yes this is bad for your website.

This is means that you don't want any Search engine to index your website, hence, people wont find you in the search engines.

[monotero]

just put this in robots:

Block all query stringsDisallow: /*?

saing that not index pages with this string. this don´t generate duplicated files.

it´s bad too?

thanks

Regards

Gabo

[wissamdandan]

this is a sample of a Joomla Site that i have for robots.txt.

User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/

[monotero]

Yes, i have that.

then put:

Block all query

stringsDisallow: /*?

if i don´t put that, the crawler index me x 2 all the web pages.

example: now i have 400 indexed. if i take off that, will index like 800

[wissamdandan]

Oh yeh this is good for query strings, will not crawl non SEF URLs

So your are good

[Goetzman]

yeah, the structure of the site can get confusing.