Welcome to the Q&A Forum

Hi Deb, Thank you for your reply. I have never thought, that Google would crawl the robots.txt this rarely. I actually read it somewhere, which makes complete sense, that before they start crawling, they validate the process against robots.txt. This is one page only, but basically one of the most important ones. This is now a shocking experience for me, thank you for drawing my attention to it. Anyway, I have submitted the page through 'Fetch as Google' now. Regarding your url suggestion, I do not want them to be 404-d, at least not all of them, as for examply the login pages I still want to use, and why we have individual urls, is that because we would like our visitors to return back the page they left, before we asked them to log in. So status 200 is ok, because these pages we have for customers, but the very same pages are totally useless for Google to crawl or to index. I hope this clarifies.

Thank you again, John. I will fix this, based on our discussion.

Hi Mat, You have provided some great clarification, thank you. Now, I only have one thing to be sorted out: Should I add the DMCA protection badges to all pages with unique content, as soon as they are created? My dilemma is, that let's say I find my content somewhere else. I will submit a take down request through DMCA. How it is going to be proven, whose site owns the original content? I am definetely not an expert in this, but it can easily happen, that my page is not the older one, and the page where my content is placed to, simply just changed its previous content, but the page itself is older than my relevant page. Thank you

You're welcome.  As you might have guessed, I've tackled this problem myself a few times!!

Thank you again for your comments, Istvan. Although, I can't take everything you suggested, I understand your point, and will initiate some changes based on that. András