Welcome to the Q&A Forum

Hi There, That seems to be a bit strange and to be honest I have not seen that before. In this case I would recommend writing into help@moz.com and attach the CSV that is giving you trouble to the email. We generally prefer to work through emails sent to help@moz.com because you can speak directly with a customer service representative and we can give you updates if we need to speak with our engineering staff. In the meantime if you have any other questions or concerns please feel free to ask and I would be happy to help. Have a great day and I look forward to speaking with you soon.

Thank you for your response Sean, our domain is nuffieldhealth.com. I will email help@moz.com with full details. We have a number of broken links, duplicate page titles etc which we are aware of and are working through, however these are not new problems to our site - and also our tracked competitors DA slipped to a similar extent. Many thanks for the reply Ben

Similar questions have come up a few times. I am not sure there is a clear answer, but you may want to look at this thread: http://moz.com/community/q/612-home-page-banned [Or search on 612 in the forum search.] Good luck!

Are you just looking for an explanation of what C-blocks are? There was an excellent explanation here a while back: http://moz.com/community/q/linking-c-blocks "It refers to the part of the IP address that's different. The same class C address means something has the same third octect in the address. In the following, the first three IPs are in the same class C, and the fourth address is not. 192.168.1.1
 192.168.1.2
 192.168.1.3
 192.168.100.4 The reason we care is like what searchpl says -- it's a hint to Google that the sites are all related to each other and on the same server, and that the links may not be very natural since there is the good possibility that the same person set them up." (from Keri Morgret)

Wayne just as a follow up - We update roughly every 30 days and are currently indexing 166 Billion URLs. Our index is only getting larger and faster - if you have any specific questions feel free to reach us at help@moz.com. Have a great day!

This could be for multiple reasons. If you are looking at raw total links (not unique domains) linking to you, one blogger linking to you with a sitewide link and if that person change his blog's link display from sitewide to homepage only can impact numbers like that. Have you also been monitoring your competitor links ? How have they changed ? Also, the quality of the sites OSE uses it's in index would improve over time, in which case spam blogs etc might get dropped, thereby causing in reduction in the number of links. There could be a number of things. See OSE Stats below from their update on 9th Oct, 2014 166,012,290,869 (166 Billion) URLs 14,298,548,989 (14 Billion) subdomains 168,560,672 (168 Million) Root Domains 836,560,885,910 (836 Billion) Links Followed vs. Nofollowed 2.51% of all links found were nofollowed 63.17% of nofollowed links are internal 36.83% are external Rel Canonical - 19.74% of all pages now employ a rel=canonical tag The average page has 105.24 links on it 87.45 internal links on average 17.79 external links on average

Hey Autoschieber, There's no manual refresh unfortunately. The Reclaim Links report refreshes with every MozScape index update. So you'll see those changes reflected in the report when MozScape re-crawls the site at the beginning of November.

this is where the additional feature of when Moz last crawled a page would be great, but as this page has a PA of 1 and no known links, I would guess Moz hasn't crawled the page / found the page just yet.

Hooray! Love to hear it.

Hi George - gotcha. That makes sense. The explanation is really simple - we crawl as much as we're able to process (processing and calculating metrics like PA/DA/MozRank/MozTrust/etc are our bandwidth barreirs right now). Other services don't calculate those metrics, but Google & Bing have found ways to do both (large crawls and immediate processing at scale). We're moving to a model similar to Google soon, but in the meantime, our index is smaller than others (particularly in certain sections/parts of the deep web, less trustworthy sites, and more spammy areas of the web). I will nudge the team to get up a page on Mozscape that helps to better explain this.

Hi There We need to know the number of _______ for the root domain? The number of links? The Page Authority of the root domain? And do you mean it has not increased in comparison to its self or in comparison to the rest of the site?

Thanks guys I'll wait until the month cycles through and see if anything has changed.

Hey, I'm not sure if this is resolved for you, but as you suggest you can do something with robots.txt. Specifically, you could use wildcards to capture these URLs and tell Rogerbot (Moz's crawler) to ignore them. Here's a great Stackoverflow query to get you started and details on how block Rogerbot, you can take a look here.

Hi there! My name is Erin, and I'm on the Help Team here at Moz. Thanks for writing in to Q&A! I appologize that it took us so long to respond to your initial support email! We always aim to get back to folks as soon as we can, but we've been a little slammed lately. It looks like our amazing Mozzer Alliancer Annette followed up with you on Friday afternoon, and I'll be taking this request over from here. Our engineers are currently looking in to this. I'll follow up with you via email as soon as I have more information. Cheers! Erin

Hello! It looks like your site is fairly new, and while most new sites and links will be indexed by our spiders and Open Site Explorer within 60 days, it can sometimes take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories. Just so you know, here's how we compile our index: - We grab the most recent index.     - We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).     - We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index). Which means, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry! You can get a bit more info about our crawl here: http://moz.com/help/guides/research-tools/open-site-explorer.

Martin, Thank you for the reply, that sounds great. It seemed like the most recent index came a few weeks early (was listed as Oct 1st) and the next one is scheduled about a month out which seems like forever when you're trying to see what progress you've made, but as you mentioned, it is a ton of data to sort through on your end so definitely understand the challenges. Will be great if the next update allows for index updates on a more frequent basis and additional insights, definitely looking forward to it. Thanks again. Kyle

OSE doesn't have the resources to crawl as deeply as AHREFs, Majestic, etc., so the index is smaller. Get your backlinks from multiple sources for the best picture.

Hello! We do have another bot for our Mozscape Index (Open Site Explorer) which is dotbot We do find ourselves blocked by a hosting provider at least once a week but mostly as a result of miscommunication between marketers working with clients with multiple web developers. One or two of them may not be aware of a crawler being setup to crawl a site and will see it as malicious behavior, thus causing our bot to be blocked. This is mostly seen from larger companies.

Hi there, thanks for your question! Open Site Explorer will show the number of times the URL you enter was Liked, as well as the number of times any Facebook comments on the same URL was Like, and combine them into a single  number. This number does not include how many times your Facebook page was Liked, nor Likes via embedded buttons on the URL. Hope that clears things up. Christy

Hi Stephen! My name is Erin, and I'm on the Moz Help Team. Thanks for reaching out! Pixelbypixel is totally right, OSE isn't the end all be all of SEO. I looked into your site, and I'm guessing that the reason we're only pulling 10 internal links into the index is because your site has javascript. OSE has always had a heck of a time crawling past javascript, which would explain why you aren't seeing more links. I agree with Pixelbypixel in that it's good to compare with Majestic and Ahrefs. Each index will give you a different perspective on how your site it doing. I hope this helps, and happy Tuesday! Erin