Can Search engines crawl this page
-
Hi guys,
To put a long story short we have had to make a copy of our site and put it on another domain so in essence there are 2 copies of our site on the web.What we have done is put a username and password on the homepage - http://www.ughhwiki.co.uk/ now i just want to be 100% sure that the search engines cannot crawl this?
Thank you
Jon
-
Hi Jon
I wasn't able to access the page. Is the password just on the homepage though? If I was you I would test some other pages as you wouldn't want some one coming into the site via a search engine result if you are trying to keep everyone locked out at the moment.
Hope this helps.
-
Hi Lewis,
Thanks for the reply. We are trying to prevent this site from being able to be crawled by anyone, search engines and visitors. The login page is hopefully able to prevent google from seeing any of our content while we edit it and then put it on our actual live url. Does that make sense?
-
Google should not be able to crawl that page as long as it is password protected.
However, Google already has it indexed and password protecting it may not induce Google to de-index the page.