Welcome to the Q&A Forum

Hi, 1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot  You need to use your robots.txt file, rather than trying to do it on page 2. Once you've done the above, you can request a recrawl and they should all disappear

I can see that this is possible to do for google UK/ AU/ CA & US but is it possible to do for other countries such as Denmark, To understand what keywords our competitors rank for in the UK I have used the Keyword explorer and searched the "root domain" of relevant businesses with the "united Kingdom- en GB" as the setting. However, there is no Denmark setting. so how can I use Moz to gain insight into what keywords our competitors rank for in google search for Denmark.

Hi Jeannie, Just throwing another wild theory into the mix, could this be related to a caching issue at all? I don't suppose you're seeing the latest version but Google/other people aren't yet? I can see you're on Wordpress and use WP Rocket that's all Kind regards, Nick

Thank you.

I'm not aware of a way to remove keywords in MOZ directly, but you could always export to csv and filter it there. Or it may be that all or the majority of these keywords have a low difficulty if they are based on a brand or product name and you can filter them out that way. Just keep in mind that you may loose some good ideas by doing that.

This means that Screaming Frog is not 'waiting long enough' before returning the time-out error. Just do this: https://d.pr/i/D7Cj5M.png (screenshot) https://d.pr/i/N6xdLA.png (screenshot) Raise that number up, until you don't get 0 / Time Out any more. Note that if it does fail a lot on moderate crawl settings, there are likely to be underlying page-speed issues (either that or the machine you are crawling from has bad bandwidth) It could also be that your crawl ' frequency' is too high, go Configuration->Speed and lower the thread count (to 2-3) and the URI/s (to one or two) Finally it might be that the SF user-agent is blocked so go Configuration->User Agent and switch it to Chrome **To help you **- I did the crawl for you, here is your crawl data: https://d.pr/f/a1ux4b.zip (archive of crawl file and some exports) You can actually use my crawl file as a starting point (by double clicking it) when you want to re-crawl in future. Should be useful to you

Great help, thanks

Just testing something, ya'll. Don't mind me...

Thanks for your response. Blocking Roger-bot looks like it might be a good idea. Will this affect the DA calculation?

Just a note that we've discontinued the old Crawl Test tool and have launched an entirely new On-Demand Crawl tool based on our upgraded Site Crawl engine (launched last year). The new tool has an enhanced UI, entirely rebuilt back-end, full export capability, and will save your old crawls for up to 90 days. We've written up a sample case study or logged-in customers can go directly to On-Demand Crawl.

Hi Paul Thanks for your response. I'm always happy to hear your advise. I've been through the page code line by line. I've also fetched in google and the HTML does not contain a URL without the SRC value. I'm really stuck

If you head to 'All Crawled Pages' within the 'Site Crawl' section of your Campaign and then click 'export CSV' you will see a full list of the internal links we have been able to crawl, including various pieces of information relating to the URL's. I'm more than happy to send over screenshots from your particular Campaign - feel free to write into help@moz.com Eli

Hey, Thanks for reaching out to us! Unfortunately this is not something that is possible within Mozbar - it sounds like it could be a great idea though! Feel free to reach out to help@moz.com if you have any other questions Eli

We are having issues with crawls for all HubSpot hosted sites as well. We love Moz so we are hoping there is a workaround for the issue. If anyone has an update on this topic, I am all ears. Thank you.

Thanks for the response Lisa. Fingers crossed the site moves this way

Hey there! Kristina from the Help Team here. It sounds like you're referring to the Rank Tracker tool. If so, we made some changes to the tool in our menus due to the announcement of us sunsetting the tool on June 8th. In case you missed it, you can read more about that announcement in this Q&A post here. You can now access the tool by navigating directly to this URL: https://moz.com/researchtools/rank-trackeror by navigating to your Moz Pro Home option and then scrolling down to the available tools. I made a quick video here for you demonstrating this piece. I hope this helps but certainly let us know if there's more we can assist with on this, and sorry for the confusion!

good answer: P

Users have been begging for this functionality for many, many years and It's been recognised and promised as a "highest priority" many times, but nothing's ever come if it, unfortunately, I'd recommend assuming it will never be provided. (And yea, this has been a sore point for a lot of users). Paul

Hi!. You can use MOZ, RSS feed and also IFTTT  to configure the alerts you want. I think you can use them to create backlink alerts. Here is an example at MOZ's Blog: https://moz.com/ugc/get-email-alerts-for-new-backlinks-with-open-site-explorer I can not tell you about Ahrefs, because I do not use it. I hope I could have helped.

Thanks Eli