Why specify robots instead of googlebot for a Panda affected site?
-
Daniweb is the poster child for sites that have recovered from Panda. I know one strategy she mentioned was de-indexing all of her tagged content, fo rexample: http://www.daniweb.com/tags/database
Why do you think more Panda affected sites specifying 'googlebot' rather than 'robots' to capture traffic from Bing & Yahoo?
-
Hi there,
I'm not sure of the percentage of sites who have specified all bots as opposed to just Google, but I also have to assume that the percentage depends on the sites' territory. For instance, there are few sites in the UK who would think of Bing or Yahoo, due to those search engines having a tiny market share. In the US, Japan and several other places where non-Google search engines have more share, the consideration will be much higher.