Why is my homepage not indexed by Google or Bing
-
http://www.schoppnutritionclinic.com/
Home page is not indexed by Google or Bing but all other pages are indexed. I know that currently i am missing the robot.TXT file and the sitemap. This is something i am woking on as a possible solution.
I would have thought Google/Bing would have still indexed this page regardless of the lack of sitemap/robot.txt files not being present.
I attempted to run a fetch and render in Webmaster tools and received a Not Found status.
-
This is shoot in the dark but definitely it's related to not indexed homepage.
I found that your site didn't return proper 404 error:http://www.schoppnutritionclinic.com/tester-blah-blah
http://www.schoppnutritionclinic.com/tester
http://www.schoppnutritionclinic.com/test
All pages above return "200 OK" and there isn't "404 Not found" error. This is called soft-404.So bot trying to index different pages and he finally didn't index your homepage because it's same as something other page. I.e. you have duplicated page.
How to fix this?
- You should implement hard 404 error.
- You should implement canonical page tags.
Both will give to crawlers enough information about actual pages presence or absence. And bot will know about true location of your pages in case of duplication.
-
Interesting. Literally none of the crawler tools I've just tried using give me anything more than a 404 for your home page and that's where they stop.
I can see the 301 from the non-www version so the domain itself is crawlable - I'm wondering if maybe it's a htaccess issue?
The best I can work out from the outside is that something is wrong with your htaccess file, maybe it's pointing to an invalid path and this is generating the 404.
Since the site currently just gives a soft 404, taking users to a page that looks like the homepage, it may be that what actually happens when you go to www.schoppnutritionclinic.com is that you're being handed the soft-404 and just thinking it's your home page.
It's impossible to test further without access to these things but hopefully this points you in the right direction. I'd be interested to see the outcome here regardless; it's bugging me now!