A site is not being indexed by Google Yahoo or Bing
-
This site - http://adoptionconnection.org/ is not being indexed by any of the search engines. I checked the easy stuff - robots text is:
<meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">all, index, follow</a>" /> <meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noodp</a>" /> <meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noydir</a>" /> I have checked what I can determine would cause the issue but have found nothing to prevent it from being indexed. I'm thinking it may be re-directs etc. Any answer would be great. Thanks in advance, -
You could make sure the relevant content is listed in your xml site map for starters : http://adoptionconnection.org/sitemap.xml ( its currently blank, assuming of course you have submitted it to Google via Webmasters tools )
Jump in to Web Masters Tools and see the crawl stats and see if there are any errors
-
The robots.txt (at http://adoptionconnection.org/robots.txt) is disallowing all bots from reading the site. Change it from:
User-agent: * Disallow: /to:
User-agent: * Disallow: -
Great answer thanks I will make sure they have submitted to webmaster tools.
-
I think this is it John! I will have them make the change tomorrow & get back on this thread to give the results.
Thanks in advance!!
-
There lies the problem , best to manual add the admin folder and other folder you dont want spiders accessing in there
This should help : http://www.robotstxt.org/robotstxt.html