Hi Etienne

I checked the campaign you have with the 902 response and the issue is with your host blocking AWS IPs. I could not find any SSL or SNI errors for the domain.

You will want to reach out to your hosting provider to make sure they are not blocking any AWS IP ranges. Our IPs are dynamic so we will not be able to provide a range for you.

There are also other issues with the SSL configuration which will need to be looked at which could result in different errors once the IPs are unblocked.

http://www.screencast.com/t/b8qEdNah

You can run a test here for any SSL domain: https://globalsign.ssllabs.com/analyze.html

Hope this helps!

Hey Allison!

We did make an unexpected change due to losing access to Bing's API for their search volume. We found that Grepwords' API has access and for an emergency solution we worked out an arrangement to partner with them to restore access to Google's Search Volume, which we lost direct access to a long time ago. We are seeing some long-trail phrases return no results but are not seeing any issues, Google may not have data for those keywords.

Hope this helps!

Hi Thomas

Do you have any filters setup in your Google profile? Any filters enabled will prevent Google from sending us you search traffic data.

As for backlinks we have a specific way of indexing links we discover from internal sites.

Here is a our guide that explains more about the process: https://moz.com/help/guides/research-tools/open-site-explorer#frequently-asked-questions

Hello!

The standard and medium plans will each have a set limit to crawl up to 50,000 pages. The higher plans have adjustable limits, 10,000, 20,000, etc.

Hope this helps

Network errors can be somewhere between us and your site and not necessarily directly with your server itself. The best bet would be to check with your ISP for any connectivity issues to your server. Since your issues are only the first time they are reported, the next crawl may be more successful.

One thing though you will want to keep your user-agent directives in a single block of code without spaces.

so

Crawlers Setup

User-agent: *

Directories

Disallow: /ajax/
Disallow: /404/
Disallow: /app/

would need to look like:

Crawlers Setup

User-agent: *

Directories

Disallow: /ajax/
Disallow: /404/
Disallow: /app/

Hi Duke!

I'm afraid square space is blocking our crawlers for some reason. Our engineers are working with their engineers for a solution. This may take some time to resolve and this is the only reason we are not able to reach your page.  

Hello!

There are two parts of our on-page grader. The discover tab which grades keywords we find ranking in the top 50 automatically and Track & Discover where you can add the URL + Keyword combo we will automatically grade each week. You can set up a custom report to obtain a PDF update to email for the overview but not for individual reports.

This is only available in a Moz Campaign.

Hope this helps!

Hi Lisa!

We are already in the process of implementing SNI through writing a new crawler since we cannot simply update our existing one. This will take some time to build and I'm afraid I do not have an exact ETA for completion.

Hi Fries,

Search volumes are now available as we are using Bings Adwords API. Unfortunately Belgium is not one of the countries supported by the API yet, however Google Adwords can pull data for you.

Here is a list of supported countries for Bings API, hopefully they will be able to add more soon.

<colgroup><col width="140"></colgroup>
| Argentina |
| Austria |
| Canada |
| Canada |
| Chile |
| Colombia |
| Denmark |
| Finland |
| France |
| Germany |
| India |
| Ireland |
| Italy |
| Mexico |
| Netherland |
| Norway |
| Peru |
| Singapore |
| Spain |
| Sweden |
| Switzerland |
| Venezuela |
| United Kingdom |
| United States |

Hello!

The categories we display are close matches to what already exists on various search engines. You would need to reach out to each service to request they add those categories.

Hi Byron

We will want to take a look at your csv file directly. Would you be able to send us your info to help@moz.com?

Cheers!

Campaigns have a 90% tolerance for duplicate content. This includes all the source code on the page and not just the viewable text. So if a URL is at least 90% similar in code to another URL, this warning will appear. Although the pages in question are may appear to be different on the front end, they are actually duplicates based on this percentage (at least the example URLs I checked in your campaigns.)

You can run your own tests using this tool: http://www.webconfs.com/similar-page-checker.php

We don't know what standard Google uses, but it's safe to say they are a bit more sophisticated than us - so you might be okay in this regard as long as you have a couple hundred words of unique text per page. Google won't say how much duplicate content is too much, so we like to be better safe than sorry.

Hope this helps!

Hey Everyone!

The search volume you're looking for is pulled from Google's Adwords API. We unfortunately no longer use the AdWords API and it's unlikely that we will be getting it back. We are working on an alternative resource for that information but we have no solid time frame right now.

The data is available directly from your AdWords account as well if you need it.

That section is separate from the rest of the report so the choices you see in the drop down will not affect the volume and will always remain static on every report.

It is a little confusing and I do apologize.

Hey Holger!

This is a great question.

One of your best options is to create separate URLs for each language as recommended by Google's documentation regarding multi-regional and multilingual sites found here:

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=182192#1

example:
1. www.website.com (english) 
2. www.website.de (german)

This would be a lot of work and (potential) site restructuring so how viable this option is would be something you would need consider.

Another option is to create a subdomain for the english site (e.g. http://en.website.de). Once this is done, you can start a campaign for both website.de and en.website.de. This way you can isolate just the english version of the site.

The last option that I can think of would be to create a campaign for your main/originating domain. If the english subfolder is housed on that domain, we'll more than likely crawl it along with the rest of the site. To separate out the English and German content, you could just filter/remove it from an exported CSV report.

Regarding your suggestion for excluding folders and URLs, this would be an excellent feature request. I recommend submitting this in our feature request forum. Our Product team checks this daily and uses it to help plan out our roadmap for future releases and may add this in there.

Hope this helped clear things up and let me know if you have any other questions. Thanks!

David Lee
SEOmoz Help Team

Hey Francisco!

For Open Site Explorer we pull shares of the exact URL you are looking up from public Facebook pages. 'Likes' are also pulled from public pages from Facebook's API and not the Facebook Page or embedded buttons on the URL.

Hope this helps and let me know if you have any questions!

Hi Janet

Listings vanishing from the check listing tool can come and go when updates are submitted so it may take a while before Yelp and Google's API finish processing the changes for us and other services when queried. This can take days to a few weeks.

Hope this helps!

The contact-us page re-directs to a different URL (about-us/contact-us) but the original source code for just www.handyrealtysa.com/contact-us matches http://www.handyrealtysa.com/community & http://www.handyrealtysa.com/resources which has no content in the main area.

While a high percentage can be considered duplicates, our crawler will also take into account the main content area to see if anything matches there as well which in the above links are different outside of the navigation and header.

Hi Peter!

Sorry you are not able to export your reports. I believe you are referring to the on page grader under research tools? We are working on restoring this and hope to have this fixed very soon. Unfortunately I do not have a solid ETA. I will update this thread as soon as I get an update!

Very sorry for the inconvenience!

Thank you!

So I took a look at your campaigns and it shows we crawled 394 pages.

http://www.screencast.com/t/bQcauoHeH27B

It's possible that your first crawl may not have picked up on the redirect but it's definitely finding pages now.

Let me know if you see something different in your settings.

Cheers,

Hi Gareth!

This will be hard to troubleshoot without knowing the full URLs. Could you send us the exact URLs you are working with to help@moz.com so we can take a look?