Will SEOMoz offer URL data relating to Bot visits
-
Does SEOMoz in the future plan to report on Bot visits for each URL, when they are spidered and when they appear in for example Google's index ?
-
Hey Neil,
To be honest we don't have anything like that in the pipeline. I think you could track that in Google Analytics and see what IPs are requesting information from your site. It is a good idea. I will drop it in our feature request forum.
-
Thanks. Because especially in the current situation with the Google updates, it would be good to know when our site URLs were last spidered and when the update appeared in Google's indexed.
Rather than having to check manually.
-
Actually, the bots may not show up in GA because it's a javascript logging system. However, if you have access to AWstats or some log file on your server, you may be able to get the information that way. I'd find out what stats system you have on your server, then start doing searches for people that have already written tools to do what you want.