Welcome to the Q&A Forum

Hi, 1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot  You need to use your robots.txt file, rather than trying to do it on page 2. Once you've done the above, you can request a recrawl and they should all disappear

Hi there! My sincerest apologies for not seeing this last response! We do consider our figures up to date for the sites that we have indexed, but the indexing process can make this seem like it isn't the case. The reason you haven't yet been indexed is not because you have a large site but simply because we haven't discovered your site yet. Just a few points on how we compile our index: We grab the most recent index. We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). We start crawling from the top down until we've crawled ~130 billion URLs The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories. You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time. Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.