Welcome to the Q&A Forum

Hey there! Thanks for reaching out to us! Our Crawler does obey robots.txt directives. Would you be able to reach out to us at help@moz.com so that we can do some investigating. I.e. So we can access your Campaigns and take a look at your website etc. Looking forward to hearing from you, Eli

Yes, logged in. But changed the email on the account a few weeks back. I'll send an email explaining. Thanks.

Thanks Tawny. The Monthly view is available now.

Hi there, Sam from Moz's Help Team here! I'm afraid that given the way we collect localised SERP data, it's only possible to track keyword rankings on a more specific level - you would need to enter specific cities. It isn't possible to track on a provincial level. Sorry about that! If you have any other questions, just let me know!

Hi there, Sam from Moz's Help Team here! You can find the keyword difficulty, and SERP analysis, right here in Keyword Explorer: https://moz.com/explorer/keyword/overview?locale=en-US&q=cat, along with keyword suggestions. You can also find the difficulty and SERP analysis in the 'Analyse a Keyword' section of your campaign, and add locally tracked keywords with a variety of search engines in the 'Tracked Keywords Overview' of your campaign. https://moz.com/help/guides/moz-pro-overview/rankings/add-and-manage-keywords/local-keywords If you'd like a more thorough runthrough, you can sign up for our Intro to Moz webinar here. In this webinar, we’ll cover how to set up your account and gain a thorough understanding of Moz Pro’s capabilities. If there’s anything else you need, just let us know!

Not happened to my sites, so pinch of salt and all that. However, imo, root cause of this could be a number of things, but is likely a resource limitation on the hosting. Slowing down the crawl may well fix the 504 issue, but if your SEO is a glorious success and the site gets more traffic, then you may be looking at 504's again. A 504 is a timeout and the problem is server side not with Moz. Made any recent DNS changes? Check your DNS health at something like https://mxtoolbox.com/domain/ Firewall active? Could be it doesn't like Rogerbot. Logs should be telling your tech team what's going on WordPress? Occasionally database corruption will cause 504's If your team isn't able to provide a little more memory (likely culprit to my mind) then consider implementing caching; this will lighten the server load and also load pages faster to boot; good for users and SEO.

Hi Humanique - you don't absolutely "need" a canonical tag on every page, but it is recommended. For example, say I had the URL: https://sparktoro.com/contact and I used a tracking parameter when I shared it on Twitter, like this: https://sparktoro.com/contact?share=twitter. Technically, it's a new URL, but it should be treated exactly like the regular version by search engines. Rel = canonical is a way to do that. You want to take the cleanest, most standard version of any page's URL and make that the one in the canonical tag in the header. Then any alternative versions that crop up through social sharing or tracking or any other way can be easily canonicaled to the right version. Again - you don't have to do this, but it is recommended by search engines and most SEOs. All the best!

is there a way to do this so that each account don't have to be logged in?

Hey Adam, Thanks for reaching out! Would you be able to write in at help@moz.com and we will be able to assist you further with regards to your payment question. Looking forward to hearing from you, Eli

Hi! Any update on this. I'm in the US and for the past two weeks, my default has switched to the UK

Hi there, Sorry for the trouble! We attempted to access that robots.txt page and it does look like we were hitting a "too many redirects" error. You will also want to make sure you are not blocking AWS, as that would stop us entirely. Checking the logs is really one of the best ways to determine how exactly your site is responding to our crawler, and if there's any way at all to get those that would be ideal for troubleshooting. Without logs, there isn't a ton we can definitively investigate. If you have questions or logs you would like to send over, we'd recommend reaching out to us at help@moz.com so that we can check out the campaign as well. Sorry we can't be more help here!

Hey, Dave from the Help Team here, You can track up to 4 search engines in various countries per campaign which you can select while setting up the campaigns or you can edit them in existing campaign under your campaign settings > rankings tab.  If you need to track more than 4 countries, a workaround would be to create a duplicate campaign that tracks results for additional search engines.  Hopefully that helps to clarify, let us know if you need anything else!

Hey Daniël ! Thanks for reaching out to us! Would you be able to send an email to help@moz.com so we can look into and speak about this a little further! Looking forward to hearing from you, Eli

Hi Simon, If your sites are only a few hundred pages and Moz is crawling 50k pages, you definitely have some crawl issues on your sites. Reducing the number of pages Moz can crawl won't fix these problems - you should have a good SEO take a look at your site to find out why so many pages can be crawled and find out if they really need to be crawled (they probably don't). You can then take the appropriate steps to improve how search engines (and crawling tools) crawl your site by blocking access to these pages. There's really no need to change your Moz subscription level for this problem. Cheers, David

Thanks Kristina, Just frustrated so wanted an instant answer of course. I will wait to hear from them.

Hi there, Sam from Moz's Help Team here! There isn't an 'Account Settings' area specifically - it's actually split into four groups. All you need to do is head to moz.com/subscriptions and you'll see multiple options here: http://www.screencast.com/t/1kSLMm0xae3G Let me know if I can help with anything else!

Hey there! Tawny from Moz's Help Team here.  Unfortunately, there's no way to sort by both location AND rank in a Custom Report, just one or the other. Sorry about that!  ​ That's a great feature request, though, so I'm going to pass this along to the product team. Maybe it's something we could include in future updates to the tool! ​Sorry I can't be more help right away. If there's anything else you need, just drop us a line at help@moz.com and we'll do our best to sort things out with you.

Hey Zouhour, Blocking Rogerbot would make it so that our crawlers could not access your site to offer Site Crawl or Page Optimization data, but your keyword rankings should still be unaffected. We don't need to be able to crawl your site to report on your keyword rankings. Only the data that requires our crawler to reach your site would be compromised, including Site Crawl, Page Optimization, and Crawl Tests. Unfortunately, there's no way to schedule our crawler — it crawls once per week, based on when you set up your Moz Pro Campaign. There's no way to change this crawl schedule. If you were able to set up a Disallow directive in your robots.txt file to exclude your ads, then you could stop Rogerbot from crawling them. That will only work if there's a distinct URL pathway for your adds that will allow you to set up a Disallow directive for our user-agent, Rogerbot. You can read more about robots.txt files and best practices over here: https://moz.com/learn/seo/robotstxt Hope that helps! If you've got any more questions, feel free to give us a shout at help@moz.com and we'll do our best to help you out!

Hi there! Jo from the Moz support team here. It sounds like you're wanting to stop rogerbot from crawling certain pages on your site. The best way to do this is to exclude rogerbot using your robots.txt file. You can read more about how to do that here https://moz.com/help/guides/moz-procedures/what-is-rogerbot If that's not possible for whatever reason, then I would recommend using the "Ignore" feature in Moz Pro Site Crawl, that way we won't keep reporting these issues. ​If there is anything else I can help you with please do let me know. Cheers! Jo

Hi there Rishi, Thanks so much for reaching out and sorry about the trouble here! Typically to resolve this we'd recommend adding a crawl delay for rogerbot to your robots.txt file. Unfortunately, at this time, our crawler isn't able to follow crawl delay directives in robots.txt files.  I'm so sorry about that!  Our engineering team is aware of the issue and are working towards a resolution however I don't have an ETA at this time. One possible solution in the interim while we work towards a fix here would be to archive the campaign so we stop crawling it, and then when we have the ability to follow crawl delays, you could un-archive your campaign. You could also block rogerbot altogether in your robots.txt file - it would look like this: User-agent: rogerbot Disallow: * Could you please pop a message about this as well to help@moz.com using your Moz email address so that we can notify our engineering team and keep you updated as soon as we are following crawl delay directives?