Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Category: Other Research Tools

Find insights and conversations specific to the Research Tools within Moz Pro.


  • Hey there! Tawny from Moz's Help Team here. You'll want to add a robots.txt file for that subdomain, and then add a Disallow command to that robots.txt file. So, using your example, you'd want a file like mediabank.mywebsite.org/robots.txt that had a Disallow command for any robots you don't want crawling that subdomain. For all user-agents, that would look something like this: User-agent: * Disallow: / That would stop any user-agents from crawling any pages on that subdomain. I hope this helps! If you've still got questions, feel free to send us a note at help@moz.com and we'll do our best to sort things out for you.

    | tawnycase
    0

  • Hey there! Tawny from Moz's Help Team here. It's tough to say without being able to look at your Campaign directly, but I can give you a hint! If you go to All Crawled Pages and download the CSV, Column B is the Referrer URL, the page our crawler was on when it found the link to the page in Column A. You should be able to trace our steps backward to find where all these links are coming from on your site. I hope that helps! If you're still needing some help, please write in to us at help@moz.com with all the details of your issue, and we'll do our very best to sort things out for ya. Cheers!

    | tawnycase
    0

  • Dave, Awesome. Thank you. I look forward to communicating through the support ticket.

    | StickyLife
    0

  • Hey there, Sam from Moz's Help Team here! You're correct - our tool has a 90% tolerance for duplicate content, which means it will flag any content that has 90% of the same code between pages. This includes all the source code on the page and not just the viewable text. You can run your own checks for percentage similarity using this tool: http://smallseotools.com/similar-page-checker/. If we're identifying two pages as having duplicate content it's likely that Google will be running into the same issues. You can read a little more about duplicate content, and how to resolve it, on our resource page here: https://moz.com/learn/seo/duplicate-content Let us know if we can help with anything else!

    | samantha.chapman
    0

  • Hey there! Sam from Moz's Help Team here! To get you started with that, I'd recommend you take a look at the keyword research chapter of our Beginner's Guide to SEO. I’d also check out these: Moz Academy: Keyword Strategy Moz Academy: Keyword Research A Step-by-Step Process for Discovering and Prioritizing the Best Keywords Diving for Pearls: A Guide to Long Tail Keywords Back to Fundamentals: 6 Untapped Keyword Sources that Will Boost Organic Traffic On Keyword Explorer, here’s the Help Hub guide to the tool, and this video series which goes through its main features and metrics: Getting Started - take a tour of our newest keyword research tool! Importance Score - this video goes into greater detail about how it functions in KWE Understanding the Metrics - more detail on how KWE metrics are determined Keyword Suggestions - more on how you can use this tool to refine or expand your keyword list SERP Analysis - what can I do with this data I hope this helps! Let us know if we can help with anything else!

    | samantha.chapman
    0

  • The immediate solution is use your robots.txt file to block the Moz crawler from crawling URLs with parameters. Pamela. User-agent: rogerbot Disallow: /*?utm Those pages are coming from the bot trying to follow links to all the different ways product pages can be sorted. You'll want to insure Googlebot isn't having the same problem. Hope that helps; Paul

    | ThompsonPaul
    0

  • Sorry for the trouble! This is an intermittent error we sometimes see. If you are still experiencing trouble, feel free to write in to help@moz.com with details about the circumstances of the error, and we can check it out! Thanks.

    | moz_support
    0

  • Hi Chris - yes! We know about this bug with the different tabs/windows and have a ticket in to the dev team to address. Thanks for the heads up.

    | randfish
    14

  • Hi MJ Our new crawler has been released last week which supports SNI. Check out our announcement here: https://moz.com/blog/new-site-crawl

    | DavidLee
    2

  • I'm not a 100% sure about it, but probably in specific cases you want to have your own statements for Rogerbot.

    | Martijn_Scheijbeler
    0

  • Hey there! Tawny from Moz's Help Team here. Since this is a pretty in-depth question, it'll be much easier to answer through our normal support channels. Please email help@moz.com with the details of your question. It would be good to mention which campaign in particular is having this issue in that email as well. We'll do our best to sort things out for you!

    | tawnycase
    0

  • I have seen this before in Moz Open Site Explorer and the "Links" section of a Moz Pro Campaign as well. This appears to be an error and I believe can happen when Moz OSE counts a 301 redirect or a URL shortener (like goo.gl) as a linking root domain, but not as an External Inbound Link. You are most likely still correct in your understanding if you were thinking that the linking root domain number is the total number of unique ".com's" that are linking to your website, where as the number of External Inbound Links are the total (according to Moz's data) number of links from all websites and pages, including all multiples on different ".com's".

    | NickW816
    1

  • Hi there! Tawny from Moz's Help Team here. Our tools aren't totally set up to give you a full list of all the pages on your site, but if you have the list of URLs you'd like to see Page Authority values for, you can check those by bulk! There actually is a way to do this—it's just a bit technical, and you may need a web developer to help you use it. We have a Mozscape API that can perform calls to check things like Domain and Page Authority in bulk. You can read more about it in our Help Hub pages, here: https://moz.com/help/guides/moz-api/mozscape And when you're ready, you can generate a key and get started over here: https://moz.com/products/api/keys I hope that helps! If you have more questions, feel free to reach out to us at help@moz.com!

    | tawnycase
    0

  • Hi Ben, When you say that your client uses Duck Duck Go to check rankings, do you mean they manually check rankings in that search engine? Or they have some sort of tracking through Duck Duck Go? It almost sounds like there needs to be a conversation to educate the client on search engine market share and why they should be more interested in tracking rankings from Google, Bing, and Yahoo!, something that a Moz Campaign can do on both a national and local level. Apologies if I misunderstood the question, happy to help further if that is the case. Best, Joe

    | Joe_Stoffel
    0

  • @nateknox & @rachel.cachel: This question is more than 1 yr old - apart from the original poster & the people who replied nobody is seeing the questions you ask. If you need help - post a new question in the Q&A

    | DirkC
    0

  • Yes, ViviCa1's suggestion that this is related to the number of pages we've crawled does look to be correct. I took a look at your campaigns and it looks like we've seen some dramatic increases in the number of pages crawled, which means that we've found more issues. With duplicate content issues in particular, crawling more pages usually sees a dramatic increase.

    | LisaHunt
    0

  • Hi! Jo here from the Moz Support team. Thanks for the feedback! i've submitted this to our product team for you. You're more than welcome to reach out to Moz support at help@moz.com with any other comments of feedback :] Cheers! Jo

    | jocameron
    1

  • Hi again Robert, Sorry for the delay in getting back to you about this! I've been away for a few days. If you submitted the sitemap directly to Google's tools, you should be seeing this in Search Console but not in the Moz tools. Google don't share this information with us (or anyone else) and it's not possible for us to detect that you've submitted this to them. I took a look at the site using MozBar and am still not seeing an error to say that you're missing an XML sitemap. We don't check for this as one of the page elements so I'm not sure where the error you're seeing would be coming from. If you'd like to send me a screenshot of the error you're seeing, to help@moz.com, I can look into it further for you.

    | LisaHunt
    0