Welcome to the Q&A Forum

Hi Nima Google will always show more links than our crawler as they are a much larger company and have multiple seeds to crawl more pages. You should use multiple tools to obtain a full link profile which is something I've seen recommended many times in our community. The 68 links we found mean those links meet the criteria we are measuring to discover them. This also means the 158 other links may not be considered as high ranking sites or your links are too deep for us to crawl or they have been crawled and are just waiting to appear in a future index update. No single index will be the same as each company crawls differently. As I mentioned earlier: We grab the most recent index We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index). Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Google does not crawl this way. This and our metrics are proprietary to Moz so it isn't that our data is unreliable or is being crawled incorrectly. The domain authority is effected by a lot of things. It is hard to pin point it without being a SEO consultant or the specific web designer on your website. Domain and Page Authority scores are both calculated using Moz's Ranking Models work. In essence, we take a lot of rankings data from the search engines (by running queries) and then try to build a predictive scoring system using our own on-page analyses and Mozscape link data to construct an algorithm that will effectively reproduce the search engines' results. Our current accuracy hovers in the 70% range, but over time, we expect to improve. Once we have a ranking model (which we internally call "uber"), we can create scores that best approximate the combinations of all our page-specific link metrics or domain-specific link metrics (removing the keyword-specific features like anchor text, on-page keyword usage, etc). These scores represent the model's query-independent or non-keyword-based ranking inputs. In simple terms, Domain Authority is our best prediction about how content would perform in search engine rankings on one site vs. another. Page Authority answers the same question for an individual page. Both are amalgamations of all the link metrics (number of links, linking root domains, mozRank, mozTrust, etc.) we have into a single, predictive score. It's important to note that both Domain Authority and Page Authority are on a 100-point, logarithmic scale. Thus, it's much more difficult to grow your score from 70 to 80 than it would be to grow from 20 to 30. Here's some places to really delve into what is going on: http://moz.com/blog/whiteboard-friday-domain-trust-authority http://moz.com/blog/googles-algorithm-pretty-charts-math-stuff http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metrics Here are some good resources to help you take a look at the factors. http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metrics http://apiwiki.seomoz.org/w/page/20902104/Domain Authority http://moz.com/blog/whiteboard-friday-domain-trust-authority I would recommend starting a new thread on the forum to seek advice from other marketers as I am only able to explain how our tools work from the technical side. Hope this helps!

That makes perfect sense.  Thank you very much

Hey Julie, Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources. Just so you know, here's how we compile our index: We grab the most recent index. We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index). Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories. As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing. I hope this helps! Please let me know if I can help you with anything else. Chiaryn Help Team Ninja

thanks...it worked, this is what i was looking for

Hi there! Setting up an alert for using the rd: parameter should pull up results for any sub domain for that domain. So rd:cnn.com would pull up blog.cnn.com, wwww.cnn.com, etc. Based on what you provided it sounds like things are set up correctly, but it's hard to dig into things like this without specific examples to review. If you're uncomfortable sharing the query here, please send in a ticket with the information so we can look into this further for you. Thanks!

Thanks for the responses Bruce and TakeshiYoung! For a full rundown on how we compile our index, check out this post. The best thing to do is to continue focusing on building high quality backlinks. This will improve the chances of your site getting more links indexed.

Hello! In campaigns you can only toggle results for the (root) domain & subdomain where on OSE you can see metrics for both and page metrics. Let me know if this helps!

Hi! It looks like we just haven't indexed your site yet. The only way to increase your chances of being indexed in Mozscape is to continue to work on building quality backlinks. Check out this post for more detailed information on how we crawl the web. Hope this helps and thanks!

Hi, If you have manually set up your geo redirect in your htaccess then you could modify your rules to redirect only if not Moz’s crawler (rogerbot) like this: uk redirect RewriteCond %{HTTP_USER_AGENT} !=rogerbot RewriteCond %{ENV:GEOIP_COUNTRY_CODE} ^GB$ RewriteRule ^(.*)$ http://uk.abcd.com$1 [L] Which means both conditions must be satisfied before the redirect happens, the user agent must not be rogerbot, and then it checks the country code. You may have to adjust it a bit depending on your setup but it’s just the same as adding an exception based on IP, so if you could already do that you can set up a user agent condition just as easily. If you’re using PHP you could use $_SERVER['HTTP_USER_AGENT'] wrap your geoip function with something like: if($_SERVER['HTTP_USER_AGENT'] != 'rogerbot' ){ You will have to check if it is not empty before you implement it (or work it into your code) as some servers have $_SERVER['HTTP_USER_AGENT'] as not set. Thanks, hope that gives you a few ideas to try! Tom

Google bot crawls your site, now Google is very powerful so it can crawl lots of sites quickly OSE aka Rogerbot he is not as powerful as Google so it takes him a bit longer to get around and crawl sites he tries his best but can't keep up with google so it takes him a bit longer. So they are both correct, if you want to see all your URLS you can do some of the following safety tips! 1. Always track any links you've created! 2. You don't have to stick to just one! Yes you can combine multiple sites like OSE, Majestic SEO & ahrefs to create a big list of the URLS that are connected to your site. 3 Don't Panic - URLS are not everything that you should be concerned by is you can't see a couple.

What is happening?  There should be a visible notification on your home page or in Moz pro.  Im about to go into a board meeting raving about Moz but have no analytics to support my request to have a budget to use you guys.  To cap it all my competitive link metrics have disappeared for 2 competitors without reason.  Not happy.

Thank you guys for the feedback, and I apologize it took so long for me to reply.  Every bit helps

This is very helpful Chris.Menke (and SamWebber)!  Thank you for the feedback and insights.  What we have been frustrated with is that we know we are building quality links on high-ranking, authority domains, yet it seemed to us that Moz was not learning of these links.  What we've tried to understand is how Moz discovers and adds these URLs to its index.  Working on theory alone, that not all of them will be discovered or accepted for index, we just want to be able to tell Moz about these relationships we are building out there - hoping that it does move our metrics from where they seem to have sat for a while.  Again, the key issue is that we want to be able to use the Moz tools, but if we don't [get] the demanded "get results", the subscription isn't going to get approved!  Needless to say, we are working double-time to build quality links from great content, but - not being social media experts - we are sort of throwing stuff against the wall hoping something will stick.  Not the greatest strategy in the world, we know!  But faint heart never won fair lady.

I don't think the page has any external links. Amazon.com has different ranking signals than Google. For instance, reviews and ratings (both quantity and quality) are a huge factor. If you'd like to learn more about it, check out this great post - http://moz.com/blog/amazon-seo-organic-search-ranking-factors by  Nathan Grimm. The best way to know what they're doing on FB is probably just to subscribe to them and pay attention to their page. See if you spot any FB ads showing up in the sidebar, or re-targeting after visiting one of their pages.

I am ramping up the Local Search, using Moz's paid Local Search and will see what happens. Thank you both for your responses.

Hello Keri. Thank you so much for your reply. I thought I may have been asking too early in the day as I am in New York. Thanks so much your reply and just as you said the index had rolled out later that day and I habe seen the increases I expected. Looking forward to the next update.

Hi Fio, What you could do is create an inbound links report in Open Site Explorer, just from the front page and make sure only the internal links are filtered out. After you're exported this data to a CSV you're able to sort the pages by Page Authority. Hope this helps!

Never mind, I figured it out

Hi there, Thanks for reaching out! My name is Erin, and I'm on the Moz Help Team. This is a tricky thing to troubleshoot since we don't have a historical database for our Index, and to my knowledge we haven't changed anything about the way we gather/report this information. Sorry I can't do more for you on the support side with this one! While I can tell you how we gather the data, ideas as to why a drop like this would occur is outside of my scope of expertise. Presashop might have a good starting point for your investigation though! I'll leave this questions as "unanswered" on my side so more folks from the community can chime in if they have any other insights. Good Luck, and Happy Tuesday! Erin

I hear ya. Why don't you register a free account for the website owner, verify the domain and use that one for now?