Welcome to the Q&A Forum

Thanks, valuable advice! I will put it to good use.

Ben, I doubt that crawlers are going to access the robots.txt file for each request, but they still have to validate any url they find against the list of the blocked ones. Glad to help, Don

Hi Dmitrii, Thanks a lot for your feedback. This really helps making some content based decisions. Best regards, Bob

Hi Andy, Thanks for sharing. I stumbled upon it right after I posted this discussion on the Q&A. It's an great video and does indeed gives a lot of helpfull information!

Hi Gianluca, Thanks for taking the time to respond. Clear answer, will keep the distribution into mind!

Whaha that's the goal actually Thanks for you responses!

How much value would these links actually give if they were followed? Just curious as they would be in the footer and would also lack relevancy as presumably websites would be getting designed for many many different companies in different industries.

Thank you both! This really helps.

So glad that was helpful, Bob! Good luck!