Site Map Problems or Are They?
-
According to webmaster tools my Sitemap contains urls which are blocked by robots.txt
Our site map is generically generated and encompasses all web pages, whether I have excluded them using the robots.txt file
As far as I am aware this has never been an issue until recently. Is this hurting my rankings and how do I fix it?
Secondly, webmaster tools says there is over 5,000 error/warnings on my site map. But site map is only 1,400 or so pages submitted. How do I see what is going on?
-
Usually, you would only put links you want indexed into the sitemap.xml file. GWT is just letting you know some of those links you posted are being blocked by robots (and wont be indexed). Shouldn't hurt your rankings if you don't want to index those pages anyways.
Check out the Optimization > Sitemaps > # errors link in GWT for more details.
-
Thanks for the robots.txt help - kind of what I figured it's just never said anything about it before.
Now for the 5000+ errors/warnings for the site map, it only allows me to see a few of them - how do I see the rest? the issue with the robot.txt problem is all i can see right now