Welcome to the Q&A Forum

good one!

Barry is spot on. You either have the meta robot line, or you do your robots.txt. I prefer to use the txt because it shows me all the rules I impose on the website at a glance and doesn't make me go and search each page individually if anything needs to be changed. Imagine having a website with 20000 pages where each is individually adjusted. If you suddenly need to change something it will take you forever. With a robots.txt it will literally take seconds.

ok, so not sure  sure this was shared.  Matt Cutts talking on this same subject. | [image: play_c.gif] | <cite class="kvm">www.youtube.com/watch?v=I2giR-WKUfY</cite> |

Hi there, I was just reading this old thread to get some info, but I'd love it if you could share you actual results from the launch. What did you do and how much did traffic change? How long before you were back to normal? I usually find that with a new website and all new URLs, I end up seeing maybe a month or sodip in traffic that can be up to 10%. But that seems to be less and less as time goes on. The search engines are usually on top of it though, they recrawl and recatalog quite quickly. Would love to hear from you. Thanks! Leslie