Hi Mark,

Sorry it's taking a while to crawl your new site.

While I'm not exactly sure what the delay is, one of the possible reasons is through your robots.txt.  Here's what I see in a short snippet from your robots.txt:

# Crawlers Setup
User-agent: *
Crawl-delay: 30
# Allowable Index
Allow: /*?p=
Allow: /index.php/blog/
Allow: /catalog/seo_sitemap/category/
Allow: /catalogsearch/result/
Allow: /media/
# Directories
Disallow: /404/
Disallow: /app/
Disallow: /cgi-bin/
Disallow: /downloader/
Disallow: /errors/
Disallow: /includes/
Disallow: /js/
Disallow: /lib/
Disallow: /magento/
Disallow: /pkginfo/
Disallow: /report/

From here, the formatting looks a little awkward. What's going on is that you're telling Roger bot to only look at these:

Allowable Index

Allow: /*?p=
Allow: /index.php/blog/
Allow: /catalog/seo_sitemap/category/
Allow: /catalogsearch/result/
Allow: /media/

While the syntax is OK, not every crawler out there will follow the allow directive. Here's an example something you can use.

# Crawlers Setup
User-agent: *
Crawl-delay: 30
Disallow: /
Disallow: /404/
Disallow: /app/
Disallow: /cgi-bin/
Disallow: /downloader/
Disallow: /errors/
Disallow: /includes/
Disallow: /js/

From here you're telling the crawler to disallow nothing except these directories. Please let us know once you implement this method is that will actually fix the crawl.

Thanks for reaching out!

Best,

Peter Li
SEOmoz Help Team
```

Hi there Claire,

Just off the hot presses.  Rank Tracker is up now!  Go check it at: ranktracker.seomoz.org.  You are probably one of the first people to know since we haven't even hit twitter and the forums yet with this information.  Please let us know how your experience is with this tool!

Best,

Peter
SEOmoz Help Team.

Hi Clare,

Thank you for reaching out!  Sorry for the lateness in which we are publicly releasing Rank Tracker.  We wanted to make it is absolutely ready before we release it for public consumption

In the meantime, we have a beta version of the tool that you can utilize at ranktrackerlb.seomoz.org, please let us know your experience on this tool at: https://seomoz.zendesk.com/entries/22457872-Keyword-Difficulty-and-Rank-Tracker-Issues ! Thank you for your awesome patience in waiting for the completely remade version of the tracker.

Best,

Peter
SEOmoz Help Team.

Hi there,

This is Peter over at SEOmoz - thanks for writing in and sorry for the confusion there! It looks like the number that you're looking at in the Web App Competitive Domain Analysis tab is the total amount of links to the entire subdomain, but the number you're looking at in Open Site Explorer is the total amount of links to that page only. Sorry about the ambiguity there! The numbers at the top of OSE all pertain solely to that URL rather than to the whole subdomain or root domain, but you can get information about the whole subdomain or root domain by going here (as an example): http://www.opensiteexplorer.org/www.seomoz.org/a!metrics. Here's a screenshot of the numbers: http://markup.io/v/djd8djeptg5n. You can also look at all the links going to the sub/root domain by changing the filters in the "Linking Pages" tab.

Peter
SEOmoz Help Team.

Hi Jason,

Thanks for reaching out! In terms of how our system handles articles and transitions in keywords.  We give our users full control on how they want to format their keywords.  In your particular case since we pull the SERPs in Google it won't affect your rankings data, however since we pull our traffic data from Google Analytics, it might be best to put in a format would make cause the least amount of friction I.e with articles and transitions. Please note for the above I am only referencing Google US, in some locale articles does matter for some search terms.

Hope that was helpful!  Let me know if you have any questions by emailing help@seomoz.org.

Best,

Hey Steve,

Thanks for writing in!  I am sorry you are experiencing some issues with your Google Analytics, looks like we are in the process of having this issue looked at on our end to see what is going on.  While it is unusual because of the frequency that it is happening, unfortunately whenever you deal with open authentication like what we have going on with Google Analytis, you will run into situations where the connection is sometimes not the most reliable.

Please know that we are doing everything we can to have this looked at to see if there is something going on.  Anyone who is also experiencing this can give us an email at help@seomoz.org and we will do our best to resolve it ASAP

Thank you again for writing in, you should hear from us soon!

Best,
Peter
SEOmoz Help Team.

Hi there,

Thanks for reaching out!  That is interesting indeed that you aren't able to create a campaign for that particular domain.  I do notice that I had trouble at first, but I tried again immediately and was able to go past the no response screen and create a campaign. http://screencast.com/t/H2apiZb0tvB.  I have checked with our team and we are not seeing an issue with the crawler so far, however in the past our crawler have had trouble with pages that is missing a Robots.txt (404 when I checked it last) http://screencast.com/t/oacVSiHM3Nyf.  However as I have shown, our crawler will now crawl sites in the absence of a robot.txt.

There's a few reason why it could be not responding to our web request:

1. The uptime was sporadic when we made the attempt.
2.  Something on the server level is blocking our web service, which is provided by Amazon.

Unfortunately the problem is too sporadic, I will start a ticket for you on my end and let's see how my campaign comes back before we decide anything.  Hope that helps!

Best,

Peter SEOmoz Help Team.

Scott,

Thanks for writing in!  With the acquisition of getlisted.org we are looking to provide a more robust and seamless experience for our local search SEOs, however we have features in the rankings tool in your campaign that you can utilize now for your reporting needs.

Let's take your pizza shop example.  If you wanted to search for how you rank in Seattle for pizza, you would simply have to tailor your keyword as this format: KW + Geotag.  In your pizza example it would just be "Pizza Seattle" or "Seattle Pizza shop", our tool will record your results and show Universal placements.  You can find more information regarding this topic here: http://www.seomoz.org/help/rankings.  One thing to note is if your SERP comes up as a local enhanced result (i.e. Google local), it won't be counted as a numeric result but rather a Universal placement tag on your historical information.  Since our tool don't consider these results to be a traditional SERP, thus we don't display it as a numeric SERP on your report.

Hope that helps, let me know if you have any questions regarding Universal placements by replying this thread or by emailing help@seomoz.org!

Best,
Peter
SEOmoz Help Team.

Hi there,

Thanks for reaching out!  It seems like you did a ton of troubleshooting.  I have tried replicating your issue on safari, so far I am not having any luck getting the redirect to happen with this or other browsers that I have.  Which leads me to think that this might be a cookie issue, as delicious as that sounds, one way you could see if you are having this issue is by turning on private browsing mode, this way your browser won't utilize a cookie to and you can see if this will get you past the redirect loop.  If this works then you will probably have to go back and delete the correct cookie.

Let me know if that works for you, if not we will think of something else!

Best,

Peter
SEOmoz Help Team.

Hi Neil,

Thanks for reaching out, I am sorry that the rankings did not update for you.  You issue could be caused by a known we had in the past, I have open a ticket for you to properly diagnose your account and take care of lost rankings we missed.  You should be hearing from me soon.

Sorry again for the inconvenience, I hope I can resolve your issues soon.

Best,
Peter
SEOmoz Help Team.

Hi there,

Thanks for reaching out!  I can definitely see why your weekly report can differ from your web app rankings.  Just so I can take a look at the data also, could you point out some examples so I could take a look or perhaps with a screenshot?  If you are more comfortable talking about this in a private setting, I could set you up with a ticket so can communicate there

Let me know how you like me to proceed.

Best,

Peter
SEOmoz Help Team

Hi there,

This is what is happening on his page, your page it looks like you purchased the 2012 bundle, the site takes you directly to the hosting page for the videos, what you see is a little different than the OP

Hope that helps!

Hi there!

Thanks for writing in!  I checked your account it seems that the crawl was finished.  Various factors sometimes can affect the speed at which Roger will check out your site, it usually tries to be as efficient as possible and not take the scenic route, every once in a while he gets stuck trying to resolve something on the site (crossword puzzle maybe) which can cause the crawl to last a little longer.  We're constantly keeping track of how long the crawls take for our customers and try to come up with a better more efficient Roger!

If your next crawl is taking more than a day (24 hours), i would send us a ticket at help@seomoz.org.  Thanks again for writing in!

Best,

Peter
SEOmoz Help Team.

Hi there,

Thank you letting us know what's going on, I've looked into your diagnostic report, it looks like they are finding these errors because some of your pages are dynamically generated based on the URL that I can see.  If you actually go into the specific report you can actually go to the page that we are seeing this, in your example if you follow the link: http://e-maximos.com/?like_it=1033\.  This is what it looks like: http://screencast.com/t/tgDGr9JLAX4b.  It looks like our tool are reporting the correct errors, although I am not sure how Roger was able to crawl those site, although it doesn't look like your robots is set up to prevent him from going there either.

Since your site is written with Word Press, this is one of those situations where Word Press is a great tool for setting up sites on the fly, it sometimes is hard to set it up correctly, since it takes the code quality control out of the users' hands with widgets and plugins.  Unfortunately our support channel don't offer consulting as part of our service since we're a product company, also in terms of a solution I will leave this discussion open to see any of our other expert users will chime in to provide some of their insight. One thing to note is that you do have a private question to ask our associates any question you want, I would utilize that to make sure you specific site audit questions gets answered.

Hope that helps!

Best,

Peter
SEOmoz Help Team.

Phillip,

Thanks for writing in!  Just so I could see the problem that you are looking at, could you let me know the reports that you are looking at that you are seeing this issue  If you could let me know which report you downloaded, I could see if I could replicate this issue!

Looking forward in hearing from you.

Peter SEOmoz Help Team.

Matt,

Can you send me a email at help@seomoz.org.  I want to take a look at your crawl results too, makes sure to let me know which crawl your results came from by letting me know the campaign

I will wait for you there!

Peter
SEOmoz Help Team.

Hi there,

That definitely looks interesting.  I started a ticket for you to go over the issues in a little more in-depth.   Roger is definitely acting a little strange, I want to take a better look at it to see if this is an issue on our end.  Once you get that email if you could go over what you were seeing before vs. now, I could give a better response on what is going on.

Hope that helps,

Peter
SEOmoz Help Team.