Robots.txt

[maestrosonrisas]

What would be a perfect robots.txt file my site is propdental.es

Can i just place:

User-agent: *

Or should i write something more???

[Chris.Menke]

Dario,

There are a  number of free tools online for creating your robots.txt file that can help you with that.  Moz has a page pertaining to it that you should check out as well. http://moz.com/learn/seo/robotstxt

[TomRayner]

Hi Dario

If you're not intending to restrict access to certain parts of the site to certain crawlers, then you won't actually need a robots.txt file at all.  So unless you have sub-folders that you want to keep private, don't worry about it.

[maestrosonrisas]

I tom thanks for answering

I not intending to restrict access. I want to make sure google crawl correctly every page of the site

is ok if i leave it like that:

**User-agent: *

Disallow:**

[TomRayner]

In that case you don't need a robots.txt file at all.

Your example above is actually very close to restricting access to your entire site.  If you had a robots.txt that looked like this:

User-agent: * 
Disallow: /

You would stop any bot or visitor from seeing the site.  Definitely not recommended!

In your case, I would avoid having a robots.txt file altogether.  It's not an SEO requirement until you need to restrict access for whatever reason.