Why is my internal followed links is 0?
-
My internal followed links is 0. Also for top pages the report say "block by robots.txt" but the Moz bot is able to crawl my site and generate report for 10K pages.
Please help me understand why.
http://www.opensiteexplorer.org/comparisons?site=www.findyogi.com
-
When I try to filter your links to internal it appears your have no internal links period. not sure why, but I do know that OSE spider works a little different than roger bot for moz campaigns per experience with some template and AJax/javascript sites.
I also do know this is the case between google and OSE. OSE does not equal google. not even close. trust your GWT data unless someone from moz can calrify why is this happening
also, i just randomly clicked an image on homepage and checked the source code, i see quite a number of no follow tags
use CTRL+F yourself to see what I mean, search for the word follow and highlight all to see them
also i see this which is a bit odd and may be part of the reason your internal links are not being read as well <a class="attribute-value">http://data-vocabulary.org/Breadcrumb</a> ???
-
Hey Naman!
I took a look at your site and I do see a lot of heavy javascript usage which might be confusing rogerbot. I've opened a ticket with our engineering team to double-check to make sure we are crawling your site and I will reply with an update sometime tomorrow.
Cheers!
-
Hi Naman,
I found the culprit! It looks like you are blocking rogerbot from crawling here:
User-agent: Ezooms
Disallow: /I just learned today that we have a crawler alias, Ezooms is an anagram of Seomoz
Removing this will let us crawl.
Hope that helps!
-
Thanks David!