Noindex follow
-
Dear all, I have two small questions for you: 1) If I have a page with many internal links, and in the head section of this page there is a noindex, follow tag, would the search engine spider the internal links placed in that page? Those internal links conduct to pages which I want the search engine to index. 2) Not related to the question above: Does it affects in any form the nofollow meta tag the way the search engine crawl internal links? I would say it onle have an effect on the exterrnal links, unless the nofollow is placed directly in the < a > tag. Thanks for your help, Daniel
-
Greetings te_c
To answer your first question, yes, the search engines would crawl (provided they are crawlable) the internal links linking to other pages on your site.
The second question I would like to answer but I need you to rephrase please? Do you mean robots.txt? You first question implied a meta tag, because that is what would appear in the section of a page.
If your instruction "no follow" is in the of your site, then the suggestion to the search engine is not to follow. Conversely, if the instruction is "follow" the engine is told to follow. This is irrespective of whether the links are internal or external. To my knowledge, there is no instruction that can be fed to search engines that says "crawl if internal, don't crawl is external." You can accomplish this of course with creative workarounds, but there is no "command" for it.
Also, keep in mind that these instructions for search engines are only suggestions. The engines may do something completely different and follow, or not depending on their "will."
I hope that's helpful!
Dana