Welcome to the Q&A Forum

Hi there! Tawny from Moz's Help Team here!

I think I can help you figure out what's going on with your robots.txt file. First things first: we're not starting at the robots.txt URL you list. Our crawler always starts from your Campaign URL and goes from there, and it can't start at an HTTPS URL, so it starts at the HTTP version and crawls from there. So, the robots.txt file we're having trouble accessing is khadination.shop/robots.txt.

I ran a couple of tests, and it looks like this robots.txt file might be inaccessible from AWS (Amazon Web Services). When I tried to curl your robots.txt file from AWS I got a 302 temporary redirect error (https://www.screencast.com/t/jy4MkDZQNbQ), and when I ran it through hurl.it, which also runs on AWS, it returned an internal server error (https://www.screencast.com/t/mawknIyaMn).

One more thing — it looks like you have a wildcard character ( * ) for the user-agent as the first line in this robots.txt file. Best practices indicate that you should put all your specific user-agent disallow commands before a wildcard user-agent; otherwise those specific crawlers will stop reading your robots.txt file after the wildcard user-agent line, since they'll assume that those rules apply to them.

I think if you fix up those things, we should be able to access your robots.txt and crawl your site!

If you still have questions or run into more trouble, shoot us a note at help@moz.com and we'll do everything we can to help you sort everything out.

Hi there!

There's nothing wrong with your listing - we're just currently unable to contact Bing and YP for listing details. This is happening for all listings. There's nothing much we can do to fix it from our end—we're working with those sites to establish a better data connection so that we can update Moz Local with their data accordingly.

If you hover over that exclamation point, it'll give a brief explanation. Sorry there's not more I can do to help you out, though!

If you have any further questions, feel free to shoot us a note at help@moz.com and we'll do our best to take care of it for ya!

Hey there, Steve!

I've just talked to the engineers who work on Open Site Explorer and Just-Discovered Links, and I can give you a bit of an update on our data sources, since our partnership with bit.ly has ended.

Currently, the only sources for JDL are some tweets, which we get through our Followerwonk credentials, and the feeds that go into Fresh Web Explorer. Unfortunately, that means that there's currently no guaranteed way of making sure your links end up in the Just-Discovered Links section of the tool. The tweets are a probabilistic sample, so something that's tweeted enough times by the right people would show up in that section eventually, but it's not a guarantee, and currently there's no way to gauge how long it would take to show up in that section.

I hope that helps to clarify - I'm sorry that I don't have an answer for how to get your links into that section!

Hi there! Tawny from Moz's Help Team here.

Thanks for writing in and sorry about the trouble!

I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. It looks like, due to the Javascript on the page, we weren't able to find any links to keep crawling: https://www.screencast.com/t/mqy7SUb9f

There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub.

While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.

You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.

I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. If you have any follow-up questions or if there's anything else you need help with, please write in to help@moz.com and we'll do our best to sort everything out.

It's not that the data is false, just that it's outdated. The last time our crawler crawled your site it found those callto links were returning a 404, but if they're no longer doing so, you don't need to worry about them. That's why I suggested a robots.txt disallow for those pages — if you know those pages are fine and you're not worried about them, you can just tell our tools to skip crawling those pages entirely so we don't report those issues anymore.

The rest of the data in the report should be as accurate as possible, given that the freshest data in our index is about 60 days old or more.

Hi there!

Since this involves sensitive account information, please write in to help@moz.com so that we can assist you further. Thanks!

It will take our tools some time to pick up on recent backlink growth. With any luck, our tools will find and index those new links to your site that you've been earning, and you'll start to see your Domain Authority increase over time.

Hey there! Tawny from Moz's Help Team here. 
Sorry for any confusion! Our locales are actually not as broad as ZIP codes, though ZIP codes are partially how they're defined.

The locales are tracked as a defined region with borders established by Google. It's hard to say exactly how Google is defining these areas, but it is likely related to ZIP codes and IP addresses.

I found this article while I was researching — it doesn't have exact answers to this question either, but had some valuable insight into Google's local search results: http://searchengineland.com/everything-need-know-pigeon-algorithm-211771. Section 7 of this resource would be the most relevant to how those locations are defined.
​
I'm afraid you would need to add smaller, individual locations to be able to track locally for those keywords. 
​
​If you have any more questions we can help with, please feel free to reach out to us at help@moz.com and we'll do our best to answer all your questions.

​

Pages canonicalized to the same page aren't duplicates, but their titles may still be. Canonicalization only affects the content of the page, not the title; the pages can still be resolved separately in the browser, so their titles may still be duplicates of one another.

If there are pages you don't want to surface in search results, you can noindex, follow those pages to prevent them showing up.

Sorry if my previous answer was a bit confusing! Hope this helps! If you've got more questions, feel free to write in to help@moz.com and we'll do what we can to sort things out for ya!

Update from the Moz Support Team: Please read our update timeframes guide for avoiding delay.

Hey there,
Tawny from Moz's Help Team here.

Moz Local is a real-time service that instantly distributes your business listing data to both data aggregators and online directories. Each of our distribution partners has their own approach for processing new and updated listings on their platform. As part of our active listing management process, we continuously verify the accuracy of each listing down to the Name, Address, Phone Number and URL across our entire partner network. We don't consider your listing to be completely accurate until a customer would find it that way.

For most partners, new data is published within 4-5 days, and the majority becomes fully accurate within a few weeks. Given how closely we track accuracy, we have seen instances where some listings have taken as much as 8-12 weeks to become fully accurate. If you're noticing an unusual delay, please let us know at help@moz.com so we can take a look at your account and see if there is anything causing the delay.

If you claim a listing on a third-party site that isn't one of our direct partners, it's up to their system to determine how long it will take for your business information to become accurate there. You'll need to work with that third-party site directly.

Moz Local should sync that info for you automatically, as long as it's one of our partners! Here is a full list of the partners that are currently supported for US business listings:

Infogroup
Acxiom
Neustar/Localeze
Factual
Foursquare
Superpages (1st Tier)
Best of the Web (2nd Tier)
Citysearch
CityGrid
Insiderpages
Hotfrog
Bing
Apple
HERE
TomTom
NavMii

We focus on top-tier data aggregators with the idea that your data will naturally trickle down throughout the local search ecosystem. And you can see the big picture of the Local Ecosystem here: https://moz.com/learn/local/local-search-data-us

If there's anything else you need, just let us know — feel free to reach out to us at help@moz.com.
Message Input

Jot something down

Hi there! Tawny from Moz's Help Team here.

This is a great question! The reason you might be seeing different inbound link information for mywebsite.com and www.mywebsite.com is because of the way other sites link back to yours. Some folks might link directly to the root domain, mywebsite.com, while others might link to the www subdomain. In that way, the two links might have slightly different backlink profiles, and could turn up different results in Open Site Explorer.

Typically if a site has both a www subdomain and a root domain page for their homepage, they'll redirect from one to the other so that visitors only see one version of the page, and so that link equity gets passed along to the correct page. In those cases, Open Site Explorer will see the redirect and offer to analyze the main page instead.

Hope that helps explain! If you've still got questions or need some clarification, feel free to drop us a line at help@moz.com and we'll do our best to sort you out!

Hi there! 
Tawny from Moz's Help team here. Is there anything we can help you with? Any questions about the tools?

If you've got questions, you can always reach the Help team at help@moz.com.

Hi there! Tawny from Moz's Help Team here with some good news - Keyword Explorer now has updated metrics and keyword volume is now international! Whoo!

Russ Joneshas been working with the team to support a larger capacity for international volume data, and we've got significant coverage for UK, Canada, and Australia, more moderate data for other Western languages and countries, and a small amount in regions and languages beyond those. Over time, we'll be refining and adding to the keyword volume corpus so we can continue to improve. You can read all about it in this blog update!

I hope this is helpful for you! If you've still got questions, feel free to write in to help@moz.com and we'll do our best to sort you out.

Thanks for hopping in to provide such stellar help to the community! Three cheers for Roman! Hip hip, hooray!

• Tawny from Moz

Hi there! Tawny from Moz's Help Team here.

It looks like you've already got some good answers here, but if you're still looking for clarification or a bit more help, feel free to write in to help@moz.com with the details of your campaign and we'll do what we can to sort things out!

That sounds correct to me - if the number of Linking Root Domains associated with SearchEngineLand is 135,000, that's links pointing to SearchEngineLand's domain, not Moz's domain.

Hi there! Tawny from Moz's Help Team here.

I'm so sorry that you're running into persistent 902 errors from your site crawl! Unfortunately, this is a technical limitation of our tools. We're in the process of building a bigger, badder, better crawler, but it isn't quite ready yet.

You're certainly not the first person to write in about this issue, so I'll be sure to take your feedback to our product team! The ability to crawl larger pages is going to be more and more important as time moves forward.

Thanks for writing in to let us know you were having issues! If you have follow-up questions or need any other help with the tools, feel free to write in to help@moz.com and we'll get things sorted out for you.

Using the disallow directive in the robots.txt file is probably the better bet as far as making sure that our tools don't crawl those pages and report duplicate page titles. I think the disallow directive is the way to go!

That said, I'm not an SEO expert, so it might be worth checking in with a web developer to see if they have different suggestions.

Hey there! Tawny from Moz's Help Team here!

The only way to make bulk checks in Open Site Explorer would be to use our Mozscape API to do those bulk checks! You can read more about the API over in our Help Hub pages, here: https://moz.com/help/guides/moz-api/mozscape/overview

It's pretty technical, so you'd likely need a web developer to help you decipher the results you get back.

I hope this helps! If you've got questions about the API or how to use it, feel free to send us a note at help@moz.com and we'll sort things out for ya!

Hopefully our wonderful Community members can hop in here with some suggestions, but I found this list that might help get you started: http://wpcurve.com/content-marketing-research-tools/