Welcome to the Q&A Forum

We can certainly check on it if you provide the domain! I would recommend sending in the information to help@moz.com where you particular case can be discussed outside the public forum.

Hi there! Moz's crawler, rogerbot, does follow robots.txt. When he's not following robots.txt, it's usually because the robots.txt protocol is formatted improperly. Learn more about formatting your page here: https://moz.com/learn/seo/robotstxt

For more information on Roger, including how to block him, head here: https://moz.com/help/guides/moz-procedures/what-is-rogerbot

And if you want to test your formatting, try the Robots Checker here: https://support.google.com/webmasters/answer/6062598

If you're still unable to determine why rogerbot is crawling your site, feel free to write in to help@moz.com!

Hey Andrew!

It's hard to determine exactly what's going on here without looking at your crawl results. Our crawler is a bit more sensitive than Google's to help identify any potential SEO issues, so it's possible that's what's happening, but it could also result from trouble reading the page in question or some other issue. If you'd like help identifying what's going on, I would recommend reaching out us at help@moz.com!

Hi there,

If you don't want us to visit those pages, you can certainly block our crawler, rogerbot, from those areas in your robots.txt file. We use a separate crawler from Google and blocking us will not impact any other company's crawler. Read more about managing rogerbot here: https://moz.com/help/guides/moz-procedures/what-is-rogerbot

You could also simply hit "Ignore" for those issues as they appear in your site crawl. That will prevent them from being reported without needing to block us in the robots file.

I hope that helps!

Hey there! Yep, you're right - that's still where we post updates about our index releases.

Hi Gareth,

When the index is updated, it's possible you may see your number backlinks drop. When we collect this data, we’re looking specifically for the most valuable links rather than crawling your entire site or every site. Our index stores link data for up to 6 months, and if links are not re-discovered from external linking sites they may fall out of the index. It is also possible that we found your links again, but that they did not meet our relevancy threshold and were excluded from the index.

Unfortunately there isn't an easy way to see which specific links were lost between index updates. The best thing we can recommend is to download a CSV of your links to use as a point of comparison for future updates.

I hope that clarifies things!

Hi there! We do take canonicals into account. Our tool has a 90% tolerance for duplicate content, which means it will flag any content that has 90% of the same code between pages. This includes all the source code on the page and not just the viewable text. If you're seeing duplicate content flagged, it's likely due to issues with how the canonical tags are set up.

For more info on canonicalization best practices, check out this article: https://moz.com/learn/seo/canonicalization

If you're still unsure why your pages are being flagged, feel free to reach out to us at help@moz.com!

Hey there!

Looking at your attachment, it seems that those sites are linking to nonexistent subdomains on your site. If you evaluate these links and decide that they are harming your site, you can disavow them using Google's disavow tool. As a general rule, if you see some weird links you probably do not need to be disavowing links. You can read more about disavowing links here: https://moz.com/blog/do-we-still-need-to-disavow-penguin

I hope that helps!

Hey there!

The only external tool that we currently integrate with is Google Analytics (and Google My Business, in Moz Local). It's certainly possible that third party sites may use our API, but that would be through interface work done on their end to use our link data! Unfortunately we do not integrate with DashThis directly within our tools. However, we can pass along this feedback to our product team! Is there a certain functionality in DashThis that you especially like?

Hey there! Sorry for any confusion here!

Unfortunately our current index crawler has never really supported custom TLDs like .london. Sorry about that! If your site previously had a supported TLD we may have crawled it at that time, but we will not crawl it with its current TLD. We do realize this is a pain point for a lot of users looking for data, and we hope to expand our TLD reach soon!

Please feel free to let us know if you have any other questions.

Hey there! Sorry for any confusion about this.

Your monthly data reports are a summary of your weekly collections, so we need to have at least 21 days worth of campaign activity within a single calendar month in order to compute the monthly roll-up. June will not have a monthly data roll-up for this reason, but you should see July data come through in the early days of August.

I hope that clarifies what's happening!

Hi Chris!

Sorry to hear you're experiencing trouble with your Best of the Web listing. This sounds like it might be a technical snafu or an update issue with that specific partner. I'd definitely recommend reaching out to us at help@moz.com so we can investigate this issue and make sure your listing information has been pushed out to all our partners!

Thanks!

Lisa

Hi there! Thanks for the question.

You are correct - at this time the API does not offer a way to call information about Discovered and Lost Links. Link Explorer and the index that supports it, including the API connection, are pretty new and still in beta testing. However, this is a call the team would like to add in the future, so keep an eye out!

Please let us know if you have any other questions, or any other features you are interested in seeing added. Thanks!

Thanks for the question!

Just to clarify, when say "references" do you mean that someone has mentioned your blog, or that someone has linked to you? Actual links to your blog will be more valuable for ranking purposes than just mentions. You can learn more about the benefits of link building here: https://moz.com/learn/seo/links-link-building

For link data, our index updates daily. Moz crawls and indexes billions of pages, adding fresh link data every day. When discovered or lost links are found, we'll update our database to reflect those changes in your scores and link counts. We prioritize the links we crawl based on a machine learning algorithm to mimic Google's index. Unfortunately because it is run by an algorithm, we can't say for certain when a particular link will appear in our index.

You can read more about our index here.

Hope that helps!

Hi there,

Thanks for the question! I can certainly speak to Keyword Explorer's numbers and how we arrived there. We use a number of sources for our volume data, including Keyword Planner, but oftentimes you will see large discrepancies because our data goes through a disambiguation process. As you noticed, Google Keyword Planner currently bundles similar keywords into one overall volume metric. Most people want specific data rather than a grouped number, so we strive to separate out the individual keyword volumes. You can read more about that here: https://moz.com/blog/google-keyword-unplanner-clickstream-data-to-the-rescue

The trouble is that often times you will have one keyword that is responsible for upwards of 95% of the traffic. So, when the data is separated out, it makes the less-trafficked keywords look suspiciously low when in fact their traffic volume is more accurate in our tool.

We have a few additional articles that discuss our volume data compared to Keyword Planner:
https://moz.com/blog/google-keyword-planner-dirty-secrets

https://moz.com/blog/moz-keyword-explorer-vs-google-keyword

I hope that helps clarify things!

Hey there Chris!

When you search for a business in our Check Listing tool, the results are populated by existing local listings out on the web. If you’re seeing two distinct verified listings, one from Facebook and one from Google+, it’s likely because their NAP (name, address, and phone number) data does not match exactly and they’re being treated as possibly separate listings. To get them to combine, you’ll want to make sure the NAP data matches.

It’s hard to know which pages exactly these are without taking a look at the search results for the business you’re querying, so if you have additional questions about the Check Listing tool (and for the sake of data privacy) I recommend writing in to us at help@moz.com!

Hey there Po!

In cases like this we'd recommend double checking that your app is submitting the call correctly. If the call itself works but when the app performs it it doesn't, our first suggestion that it is an issue with the way the app is integrating. It's really difficult to troubleshoot third party app issues because you'd need to look at the code itself to diagnose the problem. You can send us the full call to help@moz.com if you like and we can check on that for you, but we would not be able to troubleshoot your app itself.

Hi there!

Domain Authority is a proprietary metric that specifically comes from Moz, so Google does not use it. We do not disclose the exact formula for Domain Authority but you can read about the factors used to calculate in our article here: https://moz.com/learn/seo/domain-authority

I hope that helps!

Hi there,

Thanks for following up with your feedback! At the moment, we don't have an immediate replacement for Rank Tracker in place, but as you mentioned we do have several places where you can check rankings. One would be in the Campaign, especially the Analyze a Keyword section which allows you to view the live SERP with the top 50 ranking sites. Another way to check live rankings is using Keyword Explorer. If you have a Keyword List there, you can check any URL for presence in the top 10 positions.

Another workaround for quick rankings gatherings would be to create a Campaign and add those keywords during setup. We'll do a quick rush collection and within a few hours you should see those results. You can then delete or archive that campaign if you no longer need it.

Apologies for any inconvenience caused by the removal of Rank Tracker. We have hopes to bring you better, faster, more accurate tools in the future (such as the brand new Link Explorer!), and we will certainly let the product team know that on-demand rank checking is high on your list.

Let us know if there's anything else we can do for you!

Hey there Brandon! Sorry to hear your local listings haven't completely updated.

We recommend writing in to help@moz.com so we can check out what's going on! In some cases there is a technical issue with the data push that we can clear up, but sometimes it is a delay issue with our partner sites. If you write in with your listing details we'll be happy to take a look!

As for the duplicates, closing them involves a manual review process on our partners' side that, to be honest, can take a while to complete. We can check these out for you, as well, if you write in. Thanks!